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Preface 


Over the last 50 years, the International Association for the Evaluation of Educational 
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gained in many of lEA’s studies, such as TIMSS, led to a request from members of 
the organization for an in-depth investigation of teacher preparation and training, 
particularly in terms of the subject area of mathematics. This document provides the 
framework and specifications for the first lEA study of teacher preparation and training 
of primary and lower secondary mathematics teachers. 

The framework outlines a comprehensive approach to investigating and understanding 
teacher preparation around the world and includes an attempt to understand how 
national policies and institutional practices influence the outcomes of beginning 
teachers. This focus on what beginning teachers know and can do makes this study the 
first of its kind. 

Development of the framework was a collaborative effort, which involved input not 
only from individuals who attended a series of expert group meetings but also from 
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1. Overview of the lEA TEDS-M Study 


This document outlines the framework and a comprehensive plan for a cross-national 
study of primary and secondary mathematics teacher education (TEDS-M) sponsored 
by the International Association for the Evaluation of Educational Achievement (lEA). 
TEDS-M 2008, which builds on the results of TIMSS and other earlier studies, focuses 
on how teachers are prepared to teach mathematics in primary and lower secondary 
school.^ TEDS-M is a study of the variation in the nature and impact of teacher 
education programs within and across countries. The study collects and analyzes 
nationally representative data from participating countries to address contested issues 
and improve policy and practice in teacher education. This document lays out the goals 
and justification for this study as well as its design and methodology. 

The overall study has three overlapping components: 

• COMPONENT I: Studies of teacher education policy, schooling, and social contexts 
at the national level. 

• COMPONENT II: Studies of primary and lower secondary mathematics teacher 
education routes, institutions, programs, standards, and expectations for teacher 
learning. 

• COMPONENT III: Studies of the mathematics and related teaching knowledge of 
future primary and lower secondary school mathematics teachers. 

The key research questions for the study focus on the relationships between these 
components, such as relationships between teacher education policies, institutional 
practices, and future teacher outcomes. 

1.1 lEA and the Study of Teacher Education 

Teacher education has become an area of considerable interest among policymakers in 
many countries over recent years, a development that underlines the central importance 
of teacher knowledge to quality learning. lEA’s interest in this study reflects the need to 
produce usable knowledge that will help inform policy to assist in the recruitment and 
preparation of a new generation of teachers as knowledge demands change and large 
numbers of teachers reach retirement age. 

The TEDS-M 2008 study gathers data at the following three levels of teacher education 
systems across participating countries: 

1. Outcomes: What is the level and depth of the mathematics and related teaching 
knowledge attained by prospective primary and lower secondary teachers? How does 
this knowledge vary across countries? 

2. Institutions and programs: What are the main characteristics of teacher education 
institutions and their programs? In what ways do these vary across countries? 
What are the learning opportunities available to prospective mathematics teachers 
(primary and lower secondary)? How are these structured (e.g., what is their level of 
internal/external coherence)? What content is taught in teacher education programs 
and how is this instruction organized? 


5 These teachers include specialist and non-specialist teachers who may end up teaching mathematics. 
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3. National policy: What is the national policy context for teacher education regarding, 
for example, recruitment, curriculum, quality assurance, and funding? How do these 
policies vary across countries? 

Figure 1 shows the anticipated interrelationships among the key sets of variables 
examined in TEDS-M and their location in a larger context. 

Figure 1 Interrelationships among Variables Examined in TEDS-M 



TEDS-M seeks answers to the following research questions: 

• What is the impact of mathematics-related policies for quality assurance and the 
accreditation of teacher education programs on teacher education institutions, 
programs, and outcomes? 

• How do national or program policies influence the recruitment, preparation, 
graduation, and retention of teachers of mathematics? 

• What are the characteristics of teacher education policies, institutions, and programs 
that lead to high levels of mathematics knowledge and knowledge of mathematics 
pedagogy in future teachers? 

• What relationship is there between the beliefs about mathematics of teacher educators 
and those of future teachers? 

• What kinds of practicum arrangements and school experiences are most effective in 
preparing future mathematics teachers? 

• What are the costs of programs in different settings? 
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Although the degree to which these questions can be addressed is governed to some 
extent by the culture of each participating country, the overall goal of this study is to 
find better ways to help teachers learn what they need to know to teach mathematics 
well at the primary and lower secondary school levels. In pursuing this goal, this study 
aims to speak to diverse audiences. 

In the case of educational policymakers, the aim is to suggest institutional and program 
arrangements that are effective in helping teachers become sufficiently knowledgeable. 
For teacher educators who design, implement, and evaluate teacher education programs, 
the primary aim is to give them a shared language and a shared database, and then 
shared benchmarks for examining their programs against what has proved possible and 
desirable to do in other settings. For mathematics educators, the purpose is to provide a 
better understanding of what qualified teachers of mathematics are able to learn about 
the content and the pedagogy of mathematics and the conditions these teachers need 
to acquire this knowledge. For educators in general and for informed laypersons, the 
purpose is to provide a better understanding, backed by empirical research, about how 
and what teachers learn as they prepare to teach. 

1.2 The Unique Contribution of lEA TEDS-M 

To date, no empirical cross-national study based on probability samples has analyzed 
how education systems prepare teachers of mathematics (or any other subject for that 
matter) or identified the explicit and implicit expectations for what they should know 
and be able to do as a result of this preparation. The goal of TEDS-M is to enable 
countries to compare themselves with other countries in terms of what they expect of 
their future teachers of mathematics and their ability to help students learn this subject 
matter. Countries can explore the opportunities other nations give their future teachers 
in order to meet these expectations. These comparisons should provide valuable insights 
for policymakers and teacher educators regarding diverse teacher education strategies 
in specific settings. 

As the first cross-national project to attempt this sort of study, lEA’s TEDS-M has several 
signature features (Box 1.1). 


BOX 1.1 : The Unique Features of lEA TEDS-M 

TEDS-M 2008 is the first 

• lEA study of higher education 

• lEA study of teacher education 

• Cross-national study of teacher education based on nationally representative 
probability samples 

• Cross-national study of teacher education to gather data on the knowledge outcomes 
of teacher education as well as possible determinants of these outcomes 

• Cross-national study of teacher education to integrate a specific subject matter 
(mathematics) with generic issues in teacher education policy and practice 

• Cross-national analysis of the curricula of mathematics teacher education 

• Large-scale comparative study to address the costs of teacher education. 
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This study builds on a strong research foundation and explores crucial questions to 
improve teacher education at a time of rapid global economic and social change. The 
strong foundations laid by previous studies such as TIMSS, TIMSS-Video, and PISA 
have allowed the development of a powerful design for this first cross-national study 
of mathematics teacher education. TEDS-M aims to stimulate fruitful cross-national 
dialogue among policymakers and educators regarding teacher education policy aimed 
at improving preparation for and practice in mathematics teaching. 

1.3 The Need for TEDS-M 

The justification for this study and the development of its conceptual framework, 
design, and methodology are informed by an extensive review of the research literature 
and rest on the following findings. 

1. There is significant variation in student achievement levels in mathematics across 
countries. 

The TIMSS 1999 data showed that, at Grade 8 level, 94% of Singapore students 
achieved the “top half level” of the international marker of student achievement (i.e., 
94% of Singapore students scored above the international mean of 509 points in the 
mathematics tests). A high percentage of students from Korea (82%), Japan (83%), and 
Hong Kong SAR (80%) also surpassed the score of 509 points. Students from other 
countries performed less well. In England, 48% of the tested Grade 8 students achieved 
the 509 score, a percentage similar to that for students in the United States (45%). In 
Spain, 36% of students reached the top half level, while in Portugal only 19% of the 
students did so (Mullis et ak, 2000). 

2. The school mathematics curriculum varies among countries, but we know little of 
how this variation affects teaching and learning. 

The heterogeneous performance of students in different countries has been explained 
in terms of important differences in the curricula of mathematics, including substantial 
variation in the topics included in the curriculum (textbooks, content standards, and 
teachers’ reports) across countries (McKnight et ak, 1987; Valverde, Bianchi, Wolfe, 
Schmid, & Houang, 2002). For instance, at a macro level, by Grade 8 in Japan all 
students have studied a good deal of algebra, but in many countries most students are 
just beginning to study algebra. In TIMSS 1999, only half of the participating countries 
covered the topic “estimating computations” and only about a fourth of these countries 
covered “complex numbers and their properties.” This variability is also evident in 
complex performance expectations in Grade 8 mathematics textbooks. In Iran and 
in Slovenia, the incidence of such expectations was over 70%. The rate was between 
40% and 50% in textbooks from the Gzech Republic, Germany, and Spain. In Australia, 
Golombia, Hungary, and Hong Kong SAR, the incidence of complex performance 
expectations was less than 10% (Mullis et ak, 2000). 

3. Mathematics teaching varies in quality across countries. 

Similar variability was found in the TIMSS 1999 Video Study (Hiebert et ak, 2003), 
which rated a sub-sample of mathematics lessons in five countries for coherence, 
presentation, student engagement, and overall mathematics quality. Ratings ranged 
from 1 for low to 5 for high. The study reported an average rating in each country: 
Hong Kong SAR (4.0), the Gzech Republic (3.4), Switzerland (3.3), Australia (2.9), 
the Netherlands (2.7), and the United States (2.3). Although these results should be 
interpreted with caution because of the use of small sub-samples, the differences in 
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the ratings suggest important variation in the teaching of mathematics that may help 
explain differences in achievement tests across countries. 

The 1999 TIMSS Video Study also pointed to other important differences in 
opportunities to learn mathematics across these countries, such as the content included 
in the lessons; the coherence across the mathematical problems presented in lessons; 
the topics that were introduced; the procedural complexity with which these topics 
were presented; and the quality of the individual student work and homework in class. 
Likewise, in the earlier, first TIMSS Video Study, an expert panel rated the overall quality 
of mathematics lessons in the samples for Germany, Japan, and the United States. The 
lessons were sorted into three quality categories: low, medium, and high. In Japan, 51% 
of the lessons were rated as medium quality and 39% of the lessons were rated high. In 
the United States, 89% of the lessons were rated low quality; no lesson was rated high. 
In Germany, low-quality lessons made up 34% of the whole sample, and high-quality 
lessons made up 28% of the entire sample. A similar pattern across these three countries 
was found regarding mathematical concepts that were “developed” by the teacher with 
the participation of students (77% in Japan and 22% in the United States) as opposed 
to simply “stated” by the teacher (23% in Japan and 78% in the United States) (Stigler 
&Hiebert, 1997, 1999). 

1.4 Assumptions Underlying the TEDS-M Design 

Since the literature indicates that mathematics is taught in different ways in different 
countries and that this variation may be related to the ways in which future teachers are 
prepared, we turn to the issues posed by studies of teacher preparation. This study is 
constructed to provide a strong empirical base from which to assess the impact of teacher 
education policy, as mediated through institutional and organizational arrangements, 
on the quality and depth of teachers’ mathematical knowledge and abilities. Previous work 
supports our making certain assumptions to serve as the starting points for TEDS-M. 

1 . Teacher education is understood and implemented differently across national settings 
and even between institutions within the same country. 

The recent OECD studies on recruiting, preparing, and retaining effective teachers 
indicate that teacher education varies in very important ways across the 25 participating 
countries. The synthesis report Teachers Matter (Organisation for Economic 
Co-operation and Development/OECD, 2005) indicates, for example, that in some 
countries students start teacher education directly after secondary school. However, 
in others, prospective teachers already have a university degree or other experience. In 
a number of countries, universities are not the only providers and others may include 
teachers’ colleges and/or polytechnics. 

The report also indicates that some teacher education programs are “concurrent” in that 
teacher education is combined with undergraduate preparation in a discipline outside 
education. Other programs are “consecutive” in that the teacher education program 
with a focus on pedagogy and teaching is taken after the candidate has finished a first 
degree in a subject-matter area. According to the report, some countries have a “unitary” 
system with only one “route” to becoming a teacher. Others are “segmented” and offer 
more than one route. Some routes are concentrated within university faculties of 
education while others are spread through a number of faculties in large universities. 
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According to the report, programs also vary greatly in duration. “The range is from 3 
years (e.g. for some primary teachers in Ireland and Spain) up to 6.5 years for some 
secondary teachers in Germany, 7 years in the Slovak Republic and 8 years in Italy” 
(p. 21). Duration also varies within countries. The report notes that program content 
differs in terms of subject-matter knowledge, pedagogic knowledge, educational 
sciences, educational psychology, and practical experience (OECD, 2005). 

The report also indicates that different agencies are responsible for the certification 
of new teachers. These include institutions of higher education, professional bodies, 
and state authorities, which impose varying requirements. For example, “a number of 
countries (e.g., France, Germany, Greece, Italy, Japan, Korea, Mexico, and Spain) use 
a competitive approach ... Examinations may include observation of the candidate’s 
teaching, in-depth interviews or consideration of portfolios with records of achievement 
and work experience” (p. 22). 

Differences in organizing and implementing teacher education are expressed in the 
diverse language used to describe the components of teacher education around the 
world (Eurydice, 1998, 2002; Stuart & Tatto, 2000; UNESCO, 1998). For example, the 
word “pedagogy” has a wide array of meanings, ranging from a narrow technical focus 
on teaching technique (as used in the United States) to a broad concern with everything 
that happens in the classroom, including its moral and philosophical underpinnings 
(Hamilton & McWilliam, 2001). The broader view is represented in European discourse 
on teacher education, where the term “general pedagogy” may be used to designate all 
non-subject-matter-specific theoretical aspects of teacher education programs. In the 
United States, these would be considered “educational foundations.” 

Terms such as “practicum” and “student teaching” also vary across contexts. For 
example, in some settings, the practicum experience may occur throughout a student’s 
university career and be tightly connected to university coursework; in other places, the 
practicum — or field experience more generally — is a stand-alone experience. Similarly, 
the chief activity of the practicum may require the future teacher to take the lead in 
lesson planning and teaching students (as is often the case in a number of systems in the 
European Union and the United States). In other places, such as Ghina, the practicum 
experience, or “student teaching,” emphasizes observation and detailed preparation of 
a very small amount of classroom teaching (perhaps as little as four to six periods in 
total). 

Even when the number of weeks required do not differ dramatically, there is variation 
in the nature, focus, and substance of the activities in question (Britton, Paine, Pimm, 
& Raizen, 2003; Paine, 1990). The challenge, in this case, is gaining clarity about the 
various forms that teacher education takes (in logic, timing, content, and structure) 
and remaining acutely sensitive to this variation in language in order to deepen 
understanding of the phenomenon in question. The definitions included in this 
framework therefore are not meant to be definitive, but rather a beginning point for 
this process of clarification. 

The differences in teacher education are also reflected in its costs. The economic 
dimension of teacher preparation includes the variable costs of becoming a teacher 
across countries as well as the expenses institutions incur in preparing teachers across 
the disciplinary spectrum. The conceptual and empirical work conducted by Tatto and 
her colleagues during their pioneering international study on the effectiveness and 
costs of different models of teacher preparation (Tatto, Nielsen, Cummings, Kularatna, 
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& Dharmadasa, 1990, 1993) served as a prototype for the preparatory study for 
TEDS-M (i.e., MT21, also known as P-TEDS) and TEDS-M itself 

2. Teacher education and teacher learning are complex, contested processes. 

Any research project based on the aims discussed here has to consider the complexities 
of teacher education and teacher learning. These complexities relate to lack of agreement 
among experts, policymakers, and reformers about what knowledge is most important 
to teach; competing views concerning the importance of subject matter, pedagogy, and 
knowledge of students; the relationship between theory and practice; disagreement over 
what teachers learn best from experience; the lack of standardization or even shared 
expectations for many aspects of programs; and variation in the prior knowledge of 
future teachers (Schwille & Dembde, 2007; Tatto, 1999a, 2007). 

3. Knowledge of the content to be taught is a crucial factor influencing the quality of 
teaching. 

A central motivation behind policy and programs related to the education of mathematics 
teachers is to increase the quality of teaching and consequently the quality of student 
learning. But the quality of teaching involves multiple dimensions and therefore cannot 
be assessed on the basis of only one dimension (Tatto, 2001). Nevertheless, while experts 
may fail to reach a consensus on the relative importance of these dimensions, all agree 
that knowledge of some kind is central (Monk, 1994; Porter, Eloden, Freeman, Schmidt, 
& Schwille, 1988). There remain, however, marked differences among stakeholders on 
what knowledge is important for teachers to acquire, how it is to be acquired, and how 
important that knowledge is to ensuring a teacher becomes a good teacher (Grossman, 
1990). Of particular importance for formal teacher education is the common criticism 
which asserts that teachers who are well-prepared in mathematics content knowledge 
can generally learn on the job most of what they need to teach well. 

4. Teacher education requires understanding of and addressing how teachers should 
think about mathematics, teaching, and learning. 

There is no universally accepted definition of knowledge for mathematics teaching, but 
nevertheless the last two decades have seen considerable progress in the development 
of domain-specific understanding of teacher knowledge. The roots of the concept of 
knowledge for teaching can be traced to ideas expressed by Lee Shulman in his 1985 
presidential address to the American Educational Research Association. Later, Shulman 
(1987) identified three categories of teachers’ knowledge: subject-matter knowledge, 
pedagogical content knowledge, and curricular knowledge. According to Shulman, 
subject-matter or content knowledge is the set of fundamental assumptions, definitions, 
concepts, and procedures that constitute the ideas to be learned. Pedagogical content 
knowledge (PCK) includes useful forms of representation of those ideas, powerful 
analogies, examples, and explanations of a subject, insights into what makes the learning 
of specific topics easy or difficult, and the conceptions that students of different ages and 
backgrounds bring with them to the learning of the topic. Curricular knowledge involves 
understanding how the topics are arranged over time across schooling experiences. 

Many scholars (among them. Ball & Bass, 2000; Ball & Cohen 1999; Even, 1993; Even 
& Tirosh, 2002; Fennema & Franke, 1992; Lappan, 2000) have since used Shulman’s 
categories of knowledge to characterize knowledge for teaching mathematics. Fennema 
and Franke (1992) argue that different contexts demand different knowledge and that 
teacher knowledge cannot be separated from teacher beliefs (see also DeCorte, Op’t 
Eynde, & Verschaffel, 2002; Grouws, 1992). 
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Other scholars, such as Fan and Cheong (2002), Kilpatrick, Swafford, & Findell (2001), 
and Ma (1999), have introduced related terms to describe aspects of knowledge for 
teaching mathematics. For instance, Fan and Cheong (2002) suggest three aspects of 
pedagogical knowledge: pedagogical curricular knowledge, consisting of knowledge 
of teaching materials and resources, including textbooks and technology; pedagogical 
content knowledge, including knowledge of ways to represent concepts and procedures; 
and pedagogical instructional knowledge, consisting of knowledge of teaching strategies 
and classroom organizational models. 

Measuring teacher knowledge, let alone the knowledge of future teachers, is a complex 
and challenging task and there is little agreement on what to measure and how to 
measure it (Ball, Lubienski, & Mewborn, 2001). Hill, Sleep, Lewis, and Ball (2007) give 
a good overview of attempts in the United States. They cite the Praxis series, INTASC, 
the NBPTS assessments, and their own work at the University of Michigan with the 
Learning Mathematics for Teaching (LMT) project. 

Measuring teacher knowledge cross-nationally requires paying attention to the 
differences between what Europeans call didaktik or didactique and what Americans call 
knowledge of pedagogy and teaching methods. In their useful review of the didactics of 
mathematics and the professional knowledge of teachers, Boero, Dapueto, and Parent!, 
(1996) concluded that due to differences and difficulties created by local institutions, 
and by cultural aspects and traditions, ‘tools and results of research in the didactics 
of mathematics frequently remain outside the core of mathematics teacher education, 
with a considerable waste of skills and energies.’ 

Since this review by Boero and colleagues, the work of Baumert, Blum, and colleagues 
in the COACTIV project in Germany has advanced the study of didactics in secondary 
mathematics. Influenced by Shulman’s work, they defined three aspects of mathematics 
teachers’ professional knowledge: knowledge of mathematical tasks, knowledge of 
student misconceptions and difficulties, and knowledge of mathematics-specific 
instructional strategies. A key finding of their work was that, ‘when mathematics 
achievement in grade 9 was kept constant, students taught by teachers with higher 
pedagogy content knowledge (PCK) scores performed significantly better in 
mathematics in grade 10.’ This finding confirms many other findings in the United States 
and elsewhere, namely that the so-called PCK should be considered a core candidate for 
creating powerful learning environments that continue to support students’ knowledge 
construction. 

The TEDS-M framework defines mathematical knowledge for teaching as comprising 
two main subsets of knowledge: mathematical content knowledge and mathematics 
pedagogical content knowledge. We hypothesize that the latter consists of at least 
three components — mathematical curricular knowledge; knowledge of planning for 
mathematics teaching and learning (pre-active); and enacted mathematics knowledge 
for teaching and learning (interactive). These components correspond roughly to 
Shulman’s (1987) three categories of knowledge for teaching, and to the pedagogical 
curricular knowledge and pedagogical content knowledge defined by Fan and 
Cheong (2002). 
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5. Knowledge for teaching involves consideration of the situational contexts where 
teachers will teach 

Teaching involves what has come to be called situated knowledge (Putnam & Borko, 
2000). Situating knowledge within preparation for the practice of teaching mathematics 
refers not only to the varied classroom settings in which teachers ultimately practice, but 
also to the following: teachers’ own prior primary and secondary schooling; the courses 
in which university-level content knowledge of mathematics is acquired; the courses 
in which the pedagogy of teaching mathematics is most emphasized; the classroom 
contexts for acquiring learning about mathematics in teaching during field experiences; 
and special arrangements for internships. 

The knowledge developed or modified in each of these contexts contrasts with what has 
been called general knowledge (applicable across situations and settings) and contrasts 
even more with theoretical knowledge (general knowledge explicitly formulated in 
terms of interrelated concepts and basic ideas). This conceptualization raises a question: 
is it sufficient to measure general or theoretical knowledge without regard to situated 
knowledge? (See Hammer & Elby, 2002, in this regard.) Indeed, a major issue in research 
on teacher education is how to deal with the situated character of this knowledge. 
Ball et al. (2001) take a strong position on this: “What matters ultimately is not only 
what courses teachers have taken or even what they know, but also whether and how 
teachers are able to use mathematical knowledge in the course of their work” (p. 450). 
Nevertheless, some teacher education programs are based on the view that pre-service 
teacher education programs should mainly be concerned with theoretical knowledge, 
leaving practical, situated knowledge to be acquired later and largely on the job. 

6. Teacher education embodies adevelopmentallogicofhow teachers acquireprofessional 
knowledge for the teaching of mathematics and other subjects. 

Munby, Russel, and Martin (2001) summarize research comparing expert and novice 
teachers according to a paradigm of cognitive science: 

Expert teachers possess richly elaborated knowledge about curriculum, classroom routines, 
and students that allows them to apply what they know to particular cases. Where novices 
may focus on surface features or particular objects, experts draw on a store of knowledge 
that is organized around interpretive concepts or propositions that are tied to the teaching 
environment ... (p. 889) 

Programs of teacher education typically embody this developmental logic of how 
teachers acquire their professional knowledge. For example, a common justification 
of such programs is that theoretical knowledge prepares teachers to acquire practical 
knowledge in their initial years of practice, leading eventually to a state of expert 
professional knowledge. But evidence is lacking to show that this model predicts how 
well novices construct their professional knowledge or even that it represents an ideal 
model to help someone learn to teach mathematics. While the process of how teachers 
can best acquire expert knowledge continues to be contested, the literature contains 
important insights about the state of novices’ subject-matter knowledge for teaching. 
(See Even, 1993, for a study of future secondary school teachers’ understanding of the 
function concept and their responses to student solutions and errors; and see Schmidt, 
1994, and Van Dooren, Verschaffel, & Onghena, 2002, for Canadian and Belgian studies 
on the preferences of future teachers for algebraic as opposed to arithmetic solutions to 
word problems.) 
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7. Teacher education is assumed to be linked to student achievement, but this relationship 
is poorly understood. 

The motivation for TEDS-M derives in part from the findings emerging from TIMSS, 
TIMSS-Video, PISA, and other studies which show that many students across the glohe 
do not attain desired levels of competence and understanding in mathematics. If we 
agree that teacher education is a component of schooling, then we must also agree that 
its relationship to teachers’ and students’ knowledge, although assumed important and 
proven influential by some studies (Hill, Rowan, & Ball, 2005; Mullens, Murnane, & 
Willett, 1996; Sanders & Rivers, 1996; Tatto et al, 1993), is also poorly understood. For 
instance, the Second International Mathematics and Science Study (McKnight et al., 
1987) and the TIMSS 1996 and subsequent publications (Valverde et al., 2002) show 
that curriculum and content coverage are important for student achievement. TEDS-M 
explores whether future teachers acquire the knowledge related to the topics that have 
proved difficult for the students of teachers across many — if not all — countries in 
these studies. For comparison, and in order to examine levels of consistency in teacher 
preparation, TEDS-M also considers topics where achievement across countries is 
generally high. 


2. TEDS-M DESIGN 


This section describes the details of the design adopted to answer the research questions 

posed in the previous section. 

• To provide data on the POLICY AND CONTEXT of mathematics teacher education, 
TEDS-M studies the policies that influence primary and lower secondary teachers’ 
achieved level and depth of mathematics and related teaching knowledge, and how 
teacher policies influence the structure of primary and lower secondary mathematics 
teachers’ opportunities to learn. Data on policy and context are collected at the 
national level through what is described below as Component I of TEDS-M. 

• To provide data on the PROCESSES of mathematics teacher education, TEDS-M 
studies the opportunities to learn (OTL) available to future primary and lower 
secondary mathematics teachers that enable them to attain the knowledge they need 
to teach mathematics. It also studies the structure of the opportunities, the content 
taught in teacher education programs, and the organization of instruction. These 
data are collected at national, institutional, teacher educator, and future teacher 
levels, as detailed below under Component II. 

• To provide data on the OUTCOMES of mathematics teacher education, TEDS-M 
studies the level and depth of the mathematics and related teaching knowledge 
attained by future primary and lower secondary teachers, and how this knowledge 
varies across programs, routes, and countries. This is achieved through collection of 
data from representative samples of future teachers in the last year of their programs, 
as described below under Component III. 

Box 2.1 provides definitions of important terminology used in TEDS-M. 


BOX 2.1: Definitions of Terms Used in TEDS-M 
Opportunity to Learn (OTL) 

OTL is defined as an experience with an anticipated or intended learning outcome. 
TEDS-M applies this concept to teacher learning. OTL for teachers can occur at any point 
in the continuum of teacher learning, from the opportunities associated with schooling 
before entry into a formal teacher preparation program to the opportunities given to 
experienced teachers throughout their careers. TEDS-M endeavors not only to capture 
indicators of OTL throughout the teachers’ professional life-cycle but also to concentrate 
on the opportunities that future teachers have to learn mathematics, mathematics 
pedagogy, and the general pedagogy provided by their pre-service preparation programs. 
Route 

This refers to the sequence of opportunities to learn that lead future teachers from the 
end of their general secondary schooling to being considered fully qualified to teach in 
primary or lower secondary schools. In other words, a route is a prescribed pathway 
through which the teacher education programs are made available in a given country. 
Teacher preparation (TP) programs within a given route share a number of common 
features that distinguish them from TP programs in different routes. Different countries 
have different sets of routes. 
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Concurrent Routes 

The route is concurrent if its first phase consists of a single program that includes studies 
in the subjects future teachers will be teaching (academic studies), studies of pedagogy 
and education (professional studies), and practical experience in the classroom. 

Consecutive Routes 

The route is consecutive if it consists of a first phase for academic studies (leading to 
a degree or diploma), followed by a second phase of professional studies and practical 
experience (leading to a separate credential/qualification). Thus, no route can be 
considered consecutive if the institution or government authorities do not award a degree, 
diploma, or official certificate at the end of the first phase. Moreover, it may be customary 
or required for future teachers to do the first and second phases in different institutions. 
Practice (Apprenticeship) Routes 

If the route consists predominantly of school-based experience, with other institutions 
playing only a minor, marginal, supporting role, the route is primarily a practice or 
apprenticeship route. 

Teacher Preparation (TP) Institution 

This is a secondary or post-secondary school/college/university that offers structured 
OTL {Le., a program or programs) on a regular and frequent basis to future teachers within 
a route of teacher preparation. 

Program 

Within each of the sampled teacher preparation (TP) institutions, there are likely to be 
one or more TP programs provided. A program is a specific pathway that exists within 
an institution and within a route that requires students to undertake a set of subjects 
and experiences, and leads to the award of a credential on completion. For example, a 
single TP institution may provide a concurrent program that prepares primary teachers, 
a concurrent program that prepares secondary teachers, and a consecutive program that 
accepts graduates from that institution or other tertiary institutions and prepares them 
to become secondary teachers. 

Level 

The TEDS-M survey is directed at two different groups of future teachers and their 
corresponding TP institutions and educators: future teachers who are expected to teach 
mathematics — most likely as generalists — at primary schools, and future teachers who 
are expected to teach mathematics at lower secondary schools. In this manual, these two 
groups are referred to as two distinct “levels.” 

Educators of Future Teachers (or “educators” for short) 

Educators of future teachers are persons with regular, repeated responsibility to instruct 
or mentor future teachers within a given teacher preparation program. 

Future Teachers 

Future teachers are defined for the purposes of TEDS-M as persons enrolled in a teacher 
preparation program that is explicitly intended to prepare teachers qualified to teach 
mathematics in any of the grades at primary or lower secondary school level. 
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2.1 TEDS-M Studies of Policy and Context (Component I) 

In order to investigate teacher education policy and its context in each country and 
to prepare for subsequent surveys, TEDS-M includes a number of national studies as 
follows. Together, these studies form Component I of TEDS-M. 

1 . The study of routes 

2. The study of teacher education policy 

3. The studies of national and teacher education curricula 

4. The study of the costs of becoming and preparing a mathematics teacher. 

2.1.1 The Study of Teacher Preparation Routes 

TEDS-M includes a study of primary and lower secondary mathematics teacher 
education routes that lead in each participating country from completion of secondary 
school to full qualification to teach. (Box 2.1 above sets down the definition of route 
used in TEDS-M, while Box 2.2 provides background information on the concept of 
route as it applies to this study.) TEDS-M seeks to clearly identify routes in order to 
distinguish how they differ in major respects, such as their structure, their curriculum, 
the capabilities and the backgrounds of their future teachers, and the grade levels and 
types of schools for which each route prepares its graduates. 

Clarity about the routes in each country is essential to allow for comparability of 
analyses. Clear distinctions are needed, for example, between routes in which formal 
teacher education follows the completion of a university degree (known as consecutive 
routes) and routes in which subject preparation and formal teacher education are 
combined into a single program leading to a degree and eventual teaching certification 
{concurrent routes). The study of routes relies on a series of questionnaires to compile 
the necessary data. 


BOX 2.2: Background Information on Efforts to Define the Concept of Route 

As part of our effort to bring greater precision to the TEDS-M definition of the key 
concept of route, we benefited from the work of the European Eurydice project. The 
Eurydice Phase One Questionnaire for Initial Training, dated fanuary 2001, offers a basic 
definition of what Eurydice call models and what this study calls routes. The Eurydice 
definition is based on two cross-cutting distinctions. 

The first is the distinction between general education (defined as general courses and 
mastery of the subject-matters that future teachers will have to teach when qualified) as 
opposed to professional training (defined as the “theoretical and practical part of training 
devoted to teaching as such,” including short periods of assigned field experience) and 
final required on-the-job training. The second distinction is between concurrent models/ 
routes (where general education and professional training are offered together from the 
outset of the program) and consecutive models/routes (where there is a first phase of 
general education and, if considered necessary, a second phase of professional training). 
Based on these two distinctions, Eurydice posits six models or, in TEDS-M terminology, 
routes, as follows: 

• Two concurrent routes: 

- One combination of general education and professional training without a required 
final on-the-job training phase; and 

- One such combination with a final on-the-job training phase. 
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• Four consecutive routes: 

- One with a general education component only (i.e., no professional training); 

- One with a general education component, plus required final on-the-job training 
phase; 

- One with a general education component followed by a professional training component, 

but no required final on-the-job training phase; and 

- One with a general education component followed by a professional training 
component, and then a required final on-the-job training phase. 

TEDS-M adds the following factors to this definition when defining routes/approaches: 

• Mathematics-specific distinctions, such as mathematics content knowledge versus 
mathematics pedagogical content knowledge versus general pedagogical knowledge. 
The basic Eurydice definition sets mathematics content knowledge as part of general 
education and sets mathematics pedagogical content knowledge and general pedagogy 
as part of professional training. 

• Degree of specialization in subject matter and/or grade levels for which future teachers 
are being prepared. Diplomas, certihcates, and licenses vary widely between and often 
within countries — particularly in federal systems — with preparation targeted on many 
different combinations of grades (such as 1-3, 1-4, 1-6, 1-8, 4-6, 6-8, 7-8, 7-9, and so 
on). 

• ISCED level of diplomas/degrees awarded during or at the end of teacher preparation. 

• Identity and qualifications of teacher educators (e.g., requirements for experience in 
primary and secondary schools). 

• Selectivity of teacher education routes and the placement/nature of selection points 
(e.g., use of external examinations). 

• Hours devoted to different components of routes (e.g., professional training may be 
long or short). 

• Nature of on-the-job training in the route — formal versus informal. 

• Locus of control, including degree of student autonomy, teacher educator autonomy, 
and institutional autonomy in the construction of the route. 

• Residential versus distance education routes. 

• Other combinations of Eurydice components not readily represented in the six basic 
Eurydice routes. 


2. 1.1.1 TEDS-M Route Questionnaire 

This questionnaire asks the national research coordinators (NCRs) to identify all routes 
leading to teaching of primary school or lower secondary school mathematics in their 
system of teacher education. Once the NRCs know the routes to be studied by TEDS-M, 
they complete the route questionnaire to provide further information on each route. 
This questionnaire requires drawing on other sources of information, including 
interviews and focus groups as needed. Topics covered are: 

• The legislative/regulatory framework for teacher education. 

• Characteristics of the institutions, programs, and sequence that make up the route 
(including duration and numbers of institutions). 

• External examinations required and credentials awarded in each phase. 

• Nationally prescribed or recommended curriculum content for the routes. 

• Nature and amount of school-based practicum experience in the route. 

• Levels at which curriculum decisions are made for the route. 

• Qualifications required of teaching staff in the route. 
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2.1.2 The Study of Teacher Education Policy 

The TEDS-M study of teacher education policy seeks to explore in more depth the 
following questions: 

(a) What are the policies that regulate and influence the design and delivery of 
mathematics teacher education for primary and lower secondary teachers within 
and across countries? 

(h) How do countries’ distinctive political, historical, and cultural contexts shape 
mathematics teaching and learning? How do these influence policy and practice in 
mathematics teacher education? 

(c) What are the consequences of policy for the development of standards for degrees, 
coverage of topics, and certification practices? 

(d) What are the consequences of policies for the recruitment, selection, preparation, 
and retention of future mathematics teachers? Are these policies coherent across 
the hoard or do they compete with one another? 

TEDS-M is particularly interested in understanding the national® policies and practices 
in each participating country that concern monitoring and assuring the quality of 
teacher education programs and institutions and the quality of graduate teachers from 
those programs. To answer these questions and complete the international report for 
Component I, we prepared guidelines for acquiring additional information on each of 
the routes summarized in a more standardized form on the route questionnaire. The 
guidelines ask NRCs to produce a country report on national policy and the organization 
of mathematics teacher education. Such a report serves two purposes: 

(i) As a stand-alone report, which could be submitted as part of an international 
report for Component I 

(ii) As input for cross-national analyses. 

The country report is designed to complement the route questionnaire and to provide 
the contextual narratives needed to interpret the cross-national summary statistics. The 
cross-national report is designed to produce data that are standardized and therefore 
directly comparable. Box 2.3 summarizes the intended content for these reports. 


6 In countries with federal systems, the relevant policies may be formed at the state, provincial, or institutional 
level. 
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BOX 2.3: Outline for Content of Country Reports on Policy and Context 
Introduction 

Part One — Context and Organization 

• Historical, cultural, and/or social factors 

• Teaching career, teacher labor market, teacher working conditions 

• Structure and organization of teacher education 

Part Two — Quality Assurance Arrangements and Program Requirements 

• Entry standards/selection 

• Accreditation systems for teacher education 

• Curriculum requirements 

• Practicum and field experience requirements 

• Staffing requirements 

• Standards and requirements for entry to the teaching profession 
Part Three — Resources and Reforms 

• Financing of teacher education institutions and programs 

• Public debates concerning reform of teacher education 


2.1.3 The Study of Curriculum 

TEDS-M continues the tradition of examining outcomes of education in relation to the 
curricula studied. 

2. 1.3.1 Primary and Secondary Mathematics Curricula 

TEDS-M assumes that teacher education does not occur in a vacuum and thus is 
influenced hy important forces. One of these — possibly the most relevant to our 
study — is the relationship between the primary or secondary school curriculum 
standards and the degree to which teacher education emphasizes these standards. 
TEDS-M therefore analyzes mathematics curricula from Grades 1 to 8 of the participating 
countries using an updated method from that used in TIMSS and including only the 
analysis of programs of study and standards (National Center for Education Statistics/ 
NCES, 1996, 1997; Valverde et ah, 2002). The coding schemes used for the primary 
and secondary mathematics curricula provide the basis for the analysis of the teacher 
education curricula. 

TEDS-M explores the correspondence between the teacher education mathematics 
curriculum at the national level and the primary and lower secondary mathematics 
curricula, standards, and examinations. The two types of curriculum analysis provide 
validation for the domains included in the “future teacher” booklet and in the educator 
questionnaires. 

2. 1.3. 2 Curricula of Mathematics Teacher Preparation (First phase — 
national level) 

Building upon previous work analyzing primary and secondary curricula (Valverde 
et ah, 2002), TEDS-M developed a framework and a methodology for analyzing the 
curriculum of teacher education. This methodology is required to address the research 
questions in TEDS-M Component II on the practices and content associated with actual 
routes and programs, and the research questions in the TEDS-M Component III on the 
impact of these practices on the professional knowledge of future teachers. 
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While there is usually plenty of documentation about school curricula, the same does not 
apply to curricula for teacher preparation programs. For instance, many countries that 
have national standards or syllabi for school subjects do not have national standards for 
teacher education. In teacher education, many courses either do not use detailed written 
syllabi, or the syllabus used differs from educator to educator and/or from institution to 
institution. And if there are documents describing the expected or anticipated learning 
outcomes of the practicum, analysis of these can prove particularly challenging. The 
initial phase of the study of the teacher preparation curricula therefore examines 
documents prescribing or describing the national curriculum of teacher education in 
countries where these exist, or an aggregated analysis of the local or institution curricula 
when no documents at the national level are available. 

2. 1.3. 3 Curricula of Mathematics Teacher Preparation (Second phase — 
institutional program level) 

A protocol has been developed to analyze curriculum documents from the teacher 
education mathematics curricula in the selected routes and programs in relation to 
mathematics standards for primary and secondary students in each participating 
country. In addition, at the institutional level, the protocol examines the relationship 
between the content covered and the performance expectations of courses in the 
mathematics teacher education curriculum and the local or national examinations 
for teacher certification or licensing. Such analyses are expected to produce an initial 
profile of the intended curriculum in mathematics teacher education in terms of the 
knowledge, pedagogy, dispositions, and other knowledge future teachers are exposed to 
as they get ready to teach. The data for the second phase of the curriculum studies are 
collected at the same time that the institutions are surveyed (see Section 2.2, Study of 
Teacher Preparation Institutions and Programs and Their Outcomes). 

2.1.4 The Study of the Costs of Becoming and Preparing Mathematics 
Teachers^ 

In attempting to understand what it costs to prepare teachers to teach mathematics 
at the primary and secondary levels in a large number of countries, the costs study 
brings an economic dimension to TEDS-M. The study involves two phases (outlined 
immediately below). The conceptual framework for studying costs in teacher education 
was first developed by Tatto and her colleagues in an empirical study published in 
1993. The scope was expanded to include analysis of wage and salary profiles, and it 
was tested in the preparatory study for TEDS-M so that it could be used for the main 
TEDS-M survey. 

2.1.4.1 Cost Study (First phase — wage and salary profiles) 

TEDS-M estimates teacher age-wage and age-salary profiles in at least 15 of the 
participating countries and compares those profiles with similarly educated individuals 
in mathematics-oriented professions. This set of studies allows TEDS-M (once income 
per capita in country is controlled for) to test if a relationship exists between the relative 
pay of teachers and achievement on the TIMSS and PISA tests. The first part of the cost 
studies was tested in the preparatory study for TEDS-M, and it is also used for TEDS-M. 

7 The sections on the TEDS-M cost studies derive, in part, from the following document: Carnoy, M., Brodziak, 
I., Loyalka, R, Reininger, M., & Luschei, T. (2006). How much would it cost to attract individuals with more math 
knowledge into middle school (lower secondary) teaching: A seven-country comparison. Palo Alto, CA: School of 
Education, Stanford University. 
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The first phase of the cost study assumes that the higher the relative pay of teachers, the 
easier it is to attract individuals who have higher mathematics skills into teaching, and 
that it is these people who are most likely to be the better mathematics teachers. While 
pecuniary returns are certainly not the only reason that individuals choose to enter 
teaching as a career, we can still assume that removing the pecuniary “barrier” allows 
more individuals who might become good mathematics teachers to enter teaching. 

2.1.4.2 Cost Study ( Second phase — the teacher education cost study) 

This second phase of the teacher education cost study explores the costs incurred by 
teacher education programs. The education of a mathematics-oriented professional 
obviously begins before university: the high school courses that this person takes are 
likely to focus primarily on mathematics and science subjects, and the high schools 
that he or she attends may be more costly per student than the high schools attended 
by students who tend not to go into mathematics-oriented professions. While the 
study notes these points, it will not attempt to measure them, even though they may be 
important. Rather, it will focus on the post-secondary education process for primary 
and lower secondary mathematics teachers. 

A complicating factor is that there is considerable variation in the post-secondary process 
for mathematics teachers. Any study of educational costs should try to capture that 
variation by making estimates for different institutional settings and different courses 
of study, if these are prevalent in a country. We can expect, for example, different costs 
for primary, lower secondary, and upper secondary school teachers. Another important 
point is that the teaching force has trained over many years. 

The study focus is on the costs associated with formal post-secondary education — 
university and normal school training. These costs include the cost of university staff, 
and costs such as living subsidies provided to students. 

The second phase of the cost study is attached to the institution survey (see Section 2.2, 
Study of Teacher Preparation Institutions and Programs and Their Outcomes). 

2.2 Study of Teacher Preparation (TP) Institutions and Programs and 
Their Outcomes (Components II & III) 

The TEDS-M study of institutions and programs is designed to answer the following 
questions: 

(a) What kinds of institutional and field-based opportunities to learn do institutions 
and programs provide for future primary and lower secondary teachers of 
mathematics? 

(b) How are program expectations, curriculum, and standards enacted? 

(c) What are the qualifications and prior experiences of the university mathematics 
lecturers/educators/ teachers and teacher educators responsible for implementation 
of these programs? 

(d) What beliefs about teaching and learning mathematics are promoted by teacher 
education programs? 

(e) What beliefs do future teachers hold about teaching and learning mathematics at 
the end of their preparation? 

(f ) What knowledge of mathematics do the participating countries expect their future 
teachers to acquire? 

(g) What depth of understanding are they expected to achieve? 
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(h) What is the knowledge for mathematics teaching (e.g., of the content, pedagogy, 
curriculum, and attitudes) that future primary and lower secondary mathematics 
teachers actually have at the end of their teacher education and once they are 
considered “ready to teach”? 

(i) What factors explain how much impact routes, programs, and practices have on 
the mathematics knowledge and beliefs of future teachers of mathematics? 

(j) What characteristics of future teachers help explain their ability to master this 
knowledge? 

2.2.1 TEDS-M Sampling: Basic Principles and Definitions 

One of lEA’s design principles requires cross-national comparisons to be based on 
national probability samples. During the four decades of lEA history, considerable 
experience has been gained in planning and executing complex and challenging sample- 
based studies. Nevertheless, a study of the routes, programs, and outcomes of teacher 
education poses new challenges that have not been present in lEA studies of student 
achievement. In fact, TEDS-M is lEA’s first survey study in post-secondary education. 
The basic lEA approach to the study remains the same: the development of a master 
international sampling design to fit the purposes and key research questions of the study; 
adaptation of this master plan to national contexts by the national research centers; and 
negotiation by an international sampling referee of any differences in judgment about 
the adequacy of these national adaptations. 

TEDS-M conducts three independent surveys: (i) national surveys of the teacher 
preparation (TP) institutions through use of an institutional program questionnaire; 
(ii) a national survey of educators and mentors of future teachers in the TP institutions 
through use of a teacher educator questionnaire; and (iii) a national survey of future 
teachers in the sampled institutions and routes who are preparing to teach mathematics 
(either as specialists or generalists). 

The samples for the study are based on a multi-stage sampling design with probability 
proportional to size (PPS). The sample detail, specifications, and procedures are 
available in the TEDS-M sampling manual and will also be available in the TEDS-M 
technical report. 

2.2.2 Study of Teacher Preparation (TP) Institutions and Programs 

The main objective of this study is to explore the intended, as well as the implemented, 
programs of teacher preparation in the selected institutions in each country. 

2.2.2. 1 Institutional Program Questionnaire 

This questionnaire collects information about the characteristics of each program within 
the selected TP institutions. It contains the following sections: program description, 
future teacher background, selection policies, program content, field experience, 
program accountability and standards, staffing, program resources, and reflections on 
the program. It also includes questions on resources used to operate teacher education 
programs, and a general profile of teacher educators (e.g., credentials, professional path, 
courses taught).® 


8 The instruments developed for the study (with the exclusion of the knowledge tests) will be available in the 
TEDS-M technical report. 
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2.2.3 Study of Educators of Future Teachers 

TEDS-M conceptualizes the educators of future mathematics teachers as a particularly 
important vehicle through which the intended teacher education curriculum becomes 
the implemented curriculum. Although our preparatory study and field trial data show 
that the characteristics of mathematics instructors and teacher educators’ vary widely, 
the full range of this variability and how it influences the institutions in which these 
people work is not known. At present, there is no cross-national data based on scientific 
sampling of this very important population that would allow us even to begin to answer 
these questions. In fact, little survey data of any kind exists on this population. The 
TEDS-M framework uses the notion that the interaction of teacher educators with the 
curriculum and with prospective teachers shapes instruction and the OTL available to 
mathematics teachers. 

2.2.3. 1 Educator Questionnaire 

A single educator questionnaire is used to gather data from the two major groups of 
educators described above. 

Eor both the primary and lower secondary levels, the Survey for Mathematics, 
Mathematics Pedagogy, and General Pedagogy Educators addresses the following 
domains: general academic background; teaching background; professional experience; 
research experience; field-based instruction; OTL in the courses taught; coherence of the 
teacher preparation program; beliefs about mathematics; and preparedness for teaching 
mathematics. Parts of this questionnaire are designed to be similar to the future teacher 
booklet, given that it examines the correspondence and differences between educators’ 
and future teachers’ responses (on such things as knowledge, pedagogy, and beliefs) as 
an indicator of coherence and possible impact. 

National option: Questionnaire for field-based educators 

A national option was devised to include the individuals responsible for helping future 
teachers in the same program/route learn from practice in primary or lower secondary 
schools. Such persons have roles that vary greatly across countries and that may or 
may not be highly formalized, and there is no standard international terminology to 
designate the supervisors of practicum. The survey of these individuals as a TEDS-M 
national option allows further exploration on a country-by-country basis before they 
are included in a more formal definition of the target population. 

The domains addressed by this questionnaire include: general academic background; 
teaching background; teacher education experiences; OTL for field-based instruction; 
beliefs about mathematics; and preparedness for teaching mathematics. As with other 
lEA national options, the plan for surveying this group of educators was negotiated 
with the lead ISC at MSU and was approved by the lEA sampling referee and the DPC. 
Countries that choose this option collaborate in a cross-national analysis of these data. 

2.2.4 Study of Future Teachers 

TEDS-M targets future teachers who are in their final year of training before they are 
eligible to become practicing teachers of mathematics in primary and in lower secondary 
schools (either as generalist teachers or as mathematics specialists). The study provides 
indicators of the achieved curriculum of teacher preparation. 
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National option: Additional second cohort of future teachers 

For purposes of comparison, countries are given the option of surveying the entering 
future teacher cohort as well as the graduating cohort within the selected institutions. 
They can do this as a national option in consultation with the lead ISC at MSU and the 
lEA sampling referee, and with the DPC. 

2.2.4. 1 Future Teacher Booklets 

These booklets measure the intended and achieved knowledge of mathematics and 
of mathematics pedagogy of future teachers in their last year in the sampled teacher 
education programs. The booklets also ask about the future teachers’ general background, 
program learning opportunities, and beliefs about and attitudes toward teaching and 
learning mathematics. 

Because, in the case of consecutive routes, only future teachers in the last year of the 
second phase TP institution tend to be surveyed, their OTL for mathematics content 
is approximated from the study of the national curriculum as well as from their self- 
report of what they have been exposed to in earlier institutions at secondary and post- 
secondary levels. 

The future teacher questionnaire is ambitious in the domains it attempts to cover. As 
mentioned earlier, the study of teacher education represents a new practice for TEA. 
The parameters for application of the questionnaires for future teachers come from 
our feasibility study, the actual field trial, and other related studies, such as TIMSS. 
The TEDS-M item pilot and field trial carried out in 2006 and 2007 indicated that future 
teachers would be unlikely to respond to a questionnaire that exceeded 90 minutes of 
actual administration time in one session. Table 2.1 shows the overall structure of the 
future teacher booklets, with allocation of time per section. As shown, the booklet is 
administered in one 90-minute session. 


Table 2.1 Overall Booklet Structure and Allocated Times for Administration” 



Time (min) 

Part A: General Background 

5 

Part B: Opportunity to Learn 

15 

PartC: Mathematics for Teaching 

60 

Part D: Beliefs about Mathematics and Teaching 

10 


.. 


Note: “ The general knowledge for teaching questionnaire is a national option for the main study. 

Details about the items in this booklet are contained in Section 3, Measurement 
Specifications and Booklet Design. 



3. MEASUREMENT SPECIFICATIONS AND 
BOOKLET DESIGN 

3.1 Development, Trialing, and Review of Questionnaire Items^ 

The process of item development for TEDS-M has heen thorough, extensive, and 
rigorous. 

The conceptual challenges of measuring the outcomes of teacher preparation in terms 
of teacher knowledge and belief are considerable. TEDS-M builds on our development 
study (i.e., MT21), which produced an earlier and shortened version of a questionnaire 
for future lower secondary teachers to measure knowledge of (i) mathematics, (ii) 
mathematics pedagogy, and (iii) general knowledge for teaching. A number of belief 
scales and preparedness scales based on the literature were also included. These 
instruments were trialed on a small-scale basis in six countries with promising results 
and served to inform the instrument development in TEDS-M. 

Lessons from the MT21 feasibility study made it necessary to add a substantial number 
of mathematics and mathematics pedagogy knowledge items to the lower secondary 
portion of the questionnaire so that we could develop a true test of knowledge in 
these domains and report by sub-domains in important areas of mathematics and 
mathematics pedagogy. Similarly, and since our development study did not include 
the study of future primary teachers, TEDS-M developed or adapted a large number of 
items in order to test knowledge and to report by sub-domains.^” The TEDS-M research 
team accordingly solicited items from the Knowing Mathematics for Teaching Algebra 
(KAT) Project at Michigan State University, the Learning Mathematics for Teaching 
(LMT) Project at the University of Michigan, from researchers in Australia, and from 
the participating countries. The TEDS-M MSU team developed items as well. 

The item pilot took place in June 2006, and this was followed by a major field trial 
of multiple forms of the assessment instruments and questionnaires for most of the 
participating countries in March-April 2007. Thus, many of the items used in the main 
study have been subject to five rounds of international trialing in diverse countries 
(when combining the efforts from our development study and from TEDS-M). 

At each stage of the item development process, expert panels examined the content 
validity and appropriateness of the items. These reviews took into consideration clarity, 
correctness, cultural relevance, classification within the framework of domains and sub- 
domains, relevance to teacher preparation, and curricular level. In preparation for the 
field trial, detailed manuals were written for all aspects of the study (sampling, survey 
administration, and procedures, etc). Scoring guides and rubrics were prepared for all 
constructed response items, and sample responses were collected to provide a basis for 
training. All these materials were thoroughly reviewed and revised when appropriate in 
close collaboration with the country teams. Two scoring training sessions were carried 
out in preparation for the field trial and two more in preparation for the main study. 
Further details on the design of the main study and timeline can be found below and in 
Section 9 (Appendix A). 

9 The items included as examples in the appendix were tested in the field trial and dropped from the final data 
collection after the data were analyzed to determine their psychometric properties and their fit with the underlying 
constructs in the study. 

10 Another important lesson from MT21 is the need to provide careful attention to the sample design in a future 
feasibility study of any kind but most importantly when the study concerns higher education. 
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3.2 Knowledge for Teaching Mathematics: Instrument Development 

Knowledge for teaching mathematics consists of two constructs: mathematics content 
knowledge and mathematics pedagogical content knowledge (see the introduction of 
the framework for the theoretical origins of these constructs). 

3.2.1 Mathematics Content Knowledge Framework 

With a view to providing useful links to TIMSS data, the TEDS-M lead team 
proposed to members of the first NRC meeting that the instrumentation for primary 
future teachers should build on the content and cognitive domains from the TIMSS 
framework as described in the TIMSS 2007 assessment framework (Mullis et ak, 2007). 
The NRCs agreed to this proposal. They also agreed with the notion that the emphasis 
in the TEDS-M mathematics assessment should be on the content that teachers are 
required to teach. They furthermore agreed that the test should measure mathematical 
content knowledge of at least two years beyond the level they are expected to teach. This 
proviso implied that both the Grade 4 and Grade 8 TIMSS frameworks would inform 
instrument development for the content knowledge of future primary school teachers. 

Similarly, the conceptualization and instrumentation of mathematical knowledge 
for the secondary level for TEDS-M builds on the content areas used by the TIMSS 
2007 content domain assessment framework, and the TIMSS advanced assessment 
framework, as well as on the framework developed by the feasibility study for 
TEDS-M. Hence, the four subject areas assessed at both the primary and the secondary 
levels are (i) number, (ii) algebra, (hi) geometry, and (iv) data (see Table 3.1). As is 
the case for items developed for future primary teachers, TEDS-M items for students 
preparing to teach at lower secondary school concentrate on the mathematics taught 
in lower secondary grades. However, mathematics topics from upper secondary school 
and university study are also addressed. 


Table 3. 1 Mathematics Framework: Content Knowledge Domains 


NUMBER 

Whole numbers p' 

Eractions and decimals 
Number sentencesp* 

Patterns and relationships p® 
IntegersP* 

Ratios, proportions, and percents p' 
Irrational numbers p = 

Number theoryP" 


GEOMETRY 

Geometric shapes p* 
Geometric measurementP® 
Location and movementP’^ 


ALGEBRA 

Patterns p® 

Algebraic expressions p' 
Equations/formulas and functions p* 
Calculus and analysis * 

Linear algebra and abstract algebra ' 


DATA 

Data organization and representation p'^ 
Data reading and interpretation p' 
ChanceP* 



Note: P primary level; * secondary level. 

Source: TIMSS 2007 content domain assessment framework (Mullis et al., 2007); TIMSS 2008 advanced 
assessment frameworks (Garden et al., 2006) 
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The three main components of the TIMMS 2007 framework for the cognitive domains 
were also adopted for the TEDS-M mathematics items for future teachers (Table 3.2). 
Using the same conceptual framework for subject matter and cognitive domain for 
future primary and lower secondary teachers simplifies the analysis and interpretation 
of TEDS-M data. At the primary level, more emphasis was given to items addressing the 
application domain, followed by the knowing and reasoning domains. At the secondary 
level, more emphasis was placed on application, followed by reasoning and knowing 
domains. 

The curricular level of each mathematics content item was also categorized into novice 
(indicating mathematics content that is typically taught at the grades the future teacher 
will teach); intermediate (indicating content that is typically taught one or two grades 
beyond the highest grade the future teacher will teach); or advanced (indicating content 
that is typically taught three or more years beyond the highest grade the future teacher 
will teach). For both the primary and secondary levels, the largest number of items is 
targeted to measure intermediate level content. Section 9 (Appendix A) provides further 
details of the mathematics content framework. 


Table 3.2 Mathematics Framework: Cognitive Domains 


Knowing 

Recall 

Recall definitions; terminology; number properties; geometric properties; 
notation. 

Recognize 

Recognize mathematical objects, shapes, numbers and expressions; recognize 
mathematical entities that are mathematically equivalent. 

Compute 

Carry out algorithmic procedures for addition, multiplication, division, subtraction 
with whole numbers, fractions, decimals, and integers; approximate numbers to 
estimate computations; carry out routine algebraic procedures. 

Retrieve 

Retrieve information from graphs, tables, or other sources; read simple scales. 

Measure 

Use measuring instruments; use units of measurement appropriately; estimate 
measures. 

Classify/Order 

classify/group objects, shapes, numbers, and expressions according to common 
properties; make correct decisions about class membership; order numbers and 
objects by attributes. 


Applying 


Select 

Select an efficient/appropriate operation, method, or strategy for solving problems 
where there is a known algorithm or method of solution. 

Represent 

Display mathematical information and data in diagrams, tables, charts, or 
graphs; generate equivalent representations for a given mathematical entity or 
relationship. 

Model 

Generate an appropriate model, such as an equation or diagram, for solving a 
routine problem. 

Implement 

Follow and execute a set of mathematical instructions; draw figures and shapes 
according to given specifications. 

Solve Routine Problems 

Solve routine or familiar types of problems (e.g., use geometric properties to solve 
problems); compare and match different representations of data; use data from 
charts, tables, graphs, and maps to solve routine problems. 
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Table 3.2 Mathematics Framework: Cognitive Domains (contd.) 


Reasoning 

Analyze 

Determine and describe or use relationships between variables or objects in mathematical situations; use 
proportional reasoning; decompose geometric figures to simplify solving a problem; draw the net of a 
given unfamiliar solid; visualize transformations of three-dimensional figures; compare and match different 
representations of the same data; make valid inferences from given information. 

Generalize 

Extend the domain to which the result of mathematical thinking and problem-solving is applicable by 
restating results In more general and more widely applicable terms. 

Synthesize/I ntegrate 

Combine (various) mathematical procedures to establish results, and combine results to produce a further 
result; make connections between different elements of knowledge and related representations, and make 
linkages between related mathematical Ideas. 

Justify 

Provide a justification for the truth or falsity of a statement by reference to mathematical results or 
properties. 

Solve Non-routine 
Problems 

Solve problems set in mathematical or real-life contexts where future teachers are unlikely to have 
encountered closely similar Items, and apply mathematical procedures in unfamiliar or complex contexts; 
use geometric properties to solve non-routine problems. 


Source: TIMSS 2007 cognitive domain assessment framework (Mullis et al., 2007). 


3.2.2 Mathematics Pedagogical Content Knowledge Framework 

As noted in Section 1.4 of this document, the development of the framework for the 
mathematics pedagogical content knowledge was informed by the feasibility study for 
TEDS (Schmidt et ah, 2007) and the work of other researchers in the field (Ball & Bass, 
2000; Hill, Rowan, & Ball, 2005; Hill, Schilling, & Ball, 2004; Tatto et ak, 1993), as well 
as by feedback from the TEDS-M expert groups and the NRCs. Table 3.3 shows the 
framework used for both the primary and the secondary item development. Eor the 
main study, the two sub-domains “mathematical curricular knowledge” and “knowledge 
of planning for mathematics teaching and learning” (pre-active) are combined. 

3.2.3 Booklet Design and Reporting by Sub-scales for Mathematics Content 
and for Mathematics Pedagogical Content Knowledge 

TEDS-M developed scales for mathematics and for mathematics pedagogical content 
knowledge by using item response theory (IRT) methods." TEDS-M classifications for 
the cognitive domains and for the curricular levels were used solely for purposes of 
test development in order to achieve a good balance among these categories of the 
framework. Scales were not developed for these. 

These decisions have implications for the main study instruments: 

• To enable reliable reporting of measures for each sub-domain, the number of the 
items has to be reasonably large. However, because testing time for the mathematics 
assessment is limited to 60 minutes, no one participant can be expected to answer all 
items in it. Therefore, more than one test booklet is required, and the items in blocks 
need to be rotated among the assessment booklets. 

• Because some countries have “small” teacher preparation institutions (i.e., institutions 
that prepare fewer than 10 future lower secondary teachers in the last year of the 
program), problems arise if many different assessment booklets are used. 


1 1 Scales will also be developed for other areas such as beliefs, OTL, and preparedness to teach. Whether these will be 
based on IRT methods remains to be determined. 
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By using a rotated block design, TEDS-M increases the scope of the mathematics 
measurements without increasing the administration time. The field trial confirmed 
the use of this strategy for the main study. 

Five blocks are considered appropriate for the TEDS-M main study at the primary level. 
Table 3.4 presents the proposed five-booklet, five-balanced incomplete blocks (BIB) 
design for the primary-level knowledge instrument. 


Table 3.3 Mathematics Pedagogical Content Knowledge (MPCK) Framework 


Mathematical Curricular Knowledge^ 

Establishing appropriate learning goals 
Knowing different assessment formats 

Selecting possible pathways and seeing connections within the curriculum 
Identifying the key ideas in learning programs 
Knowledge of mathematics curriculum 

Knowledge of Planning for 
Mathematics Teaching and Learning 
(pre-active) 

Planning or selecting appropriate activities 
Choosing assessment formats 

Predicting*’ typical students' responses, including misconceptions 
Planning appropriate methods for representing mathematical ideas 
Linking the didactical methods and the instructional designs 
Identifying different approaches for solving mathematical problems 
Planning mathematical lessons 

Enacting Mathematics for Teaching 
and Learning (interactive) 

Analyzing or evaluating students' mathematical solutions or arguments 

Analyzing the content of students' questions 

Diagnosing typical students' responses, including misconceptions 

Explaining or representing mathematical concepts or procedures 

Generating fruitful questions 

Responding to unexpected mathematical issues 

Providing appropriate feedback 

Notes: 

“ This framework pays attention to the temporal dimension of teacher knowledge as well as the way in 
which mathematical categories refer to different types of knowledge. 

’’ Attention to choice of verbs may prove useful in distinguishing between pre-active and interactive 
dimensions of the categories. 

The TEDS-M design for the primary booklets for the field trial is shown in Section 9 
(Appendix A) of this framework report. Experience gained from the TEDS-M item and 


field trials indicates that, on average, respondents may be able to answer 30 items in 60 
minutes. Each primary block therefore contains a minimum of 12 items, each worth 
one to three score points, and requires 20 minutes of administration time. 

At the secondary level, the small size of target populations within institution, within 
program, and within country imposes further restrictions. Table 3.5 represents the 
proposed three-booklet, three-BIB design for the TEDS-M main study at the lower 
secondary level. 
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Table 3.4 TEDS-M BIB Design for the Primary-level Mathematics Knowledge 
Instrument “ 


Booklets 

Assessment Blocks 

1 

B1 

B2 

B 

2 

B2 

B3 

B4 

3 

B3 

B4 

B5 

4 

B4 

B5 

B1 

5 

B5 

B1 

B2 


Note: “ Bl, B2, B3, B4 and B5 represent the five primary mathematics blocks. 


Table 3.5 TEDS-M BIB Design for the Secondary-level Mathematics Knowledge 
Instrument “ 


Booklets 

Assessment Blocks 

1 

B1 

B2 

2 

B2 

B3 

3 

B3 

B1 


Note: “ Bl, B2 and B3 represent the three secondary mathematics blocks. 

Each secondary block contains an average of 15 items, each worth one to three score 
points, and requires 30 minutes of administration time. Section 9 (Appendix A) shows 
the booklet design for the main study at the secondary level. 

The field trial showed these designs to be empirically viable. The design provided 
precise scores, thus permitting within-country analysis, with institutions as one of the 
hierarchical units of analysis. The comparative analysis relied on the use of institutional, 
route, and country means, as these are more reliable than individual participant 
scores. 

Because of time limitations for data collection in the main study, some sub-domains 
were collapsed in order to achieve acceptable levels of reliability. 

At both the primary and the secondary levels, number and data items are grouped 
together so that three sub-domains of content knowledge (number and data, algebra, 
and geometry) can be reported. Similarly, at primary level, only two sub-domains 
of mathematics pedagogy (curriculum and planning and enacting) are reported. At 
the lower secondary level, no sub-domains are reported for mathematics pedagogy 
knowledge. 
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3.3 National Option: Exploring General Knowledge for Teaching 

General knowledge for teaching is the most unexplored knowledge area in the research 
literature. Not surprisingly, this area was slow to develop in our feasibility study. At 
the time of the field trial, much progress had been achieved, but it was not enough 
to develop a rigorous measurement instrument. Nevertheless, many of the NRCs 
in TEDS-M have a strong commitment to this area of knowledge, and the Joint 
Management Committee (JMC) therefore decided to designate it as a national option. 
Although the TEDS-M framework for this area initially drew from our feasibility study, 
it has now been changed to include “holistic scoring” and has been simplified as well for 
use in TEDS-M. As in the other knowledge areas, the items benefited from input from 
the TEDS-M expert groups as well from the NRCs’ input. The basic premise is that, in 
addition to teachers’ knowledge of content, the knowledge that teacher educators in a 
number of countries call general knowledge for teaching is essential to good mathematics 
teaching. This dimension includes the following knowledge categories: (a) students (i.e., 
knowledge of students), including the influence of socioeconomic status on teaching 
and learning; (b) classroom environment; (c) instructional design; and (d) diagnostics 
and assessment. 

The cognitive dimensions for understanding general knowledge for teaching are 
substantive knowledge of theory, practical knowledge and approach, and reasoning and 
judgment regarding pedagogy-oriented issues (Table 3.6). Euture teachers are asked 
about their knowledge of methods and practices and their ability to apply pedagogical 
knowledge to teaching-related situations. Reasoning reflects the professional judgment 
that is considered another key aspect of the general knowledge of teaching. On a smaller 
scale, these items also examine the ability of the future teacher to make connections 
between theory and practice. 


Table 3.6 General Knowledge for Teaching Framework 


Item Description 

Key Variable 

Purpose of assessment at the end of a unit 
Purpose of assessment at the start of a unit 

Reasoning 

Reasoning 

SES: Explanation of phenomenon 
SES: Accommodations in teaching 

Substantive focus 
Approach and reasoning 

Planning instruction: Evaluation of a lesson plan 

Substantive focus 

Student thinking: Cognitive development 
Student thinking: Relevant theory 

Student thinking: Link between the theory and the situation 
Student thinking: Teacher's approach to the situation 

Substantive focus 
Substantive focus 
Reasoning 

Approach and reasoning 

Student thinking: Role of teacher In seeing justification for a given answer in test 

Reasoning 

Role of increased waiting time in instruction 

Substantive focus 

Motivation: Method to motivate a student 

Approach 

Assessment: Purposes of assessment as a learning tool 

Substantive focus 


The items included in this instrument measure general knowledge for teaching in areas 
that are strongly represented in the teacher education curriculum analyzed for TEDS-M. 
These items include knowledge of students, knowledge of classroom management, 
knowledge of instructional design, and knowledge of assessment. Most items measure 
knowledge of theory and about a third of them measure knowledge of practice. 
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A more detailed description of the overall design for the field trial booklets can be 
found in Section 9 (Appendix A). 

3.4 Question Types 
3.4.1 Format 

Three question formats are used for the TEDS-M knowledge questions: multiple-choice 
(MC), complex multiple-choice (CMC), and open constructed-response (CR). Each 
multiple-choice question counts one point toward scores and sub-scores. Complex 
multiple-choice response items consist of one stem followed by a list of choices, each of 
which is scored correct or incorrect. Open constructed-response questions are scored 
from zero up to one, two, or three points, depending on the depth of understanding 
demonstrated in answering the question. Up to 74% of the questions are multiple- 
choice and complex multiple-choice response; the rest are open constructed-response. 
Eor the main study, open constructed-response items contribute about 27% of the 
items. Some of these items combine multiple-choice formats with open-ended 
formats. The weight of the open constructed-response items to the whole assessment 
is therefore not negligible. The analyses of these items provide rich information on 
patterns of responses in knowledge items. 

In theory, multiple-choice and complex multiple-choice items can be used to measure 
any of the knowledge domains. However, because of the situated nature of teacher 
knowledge, this format does not allow respondents to provide detailed interpretation of 
situations and demonstration of the knowledge that is required to teach mathematics. 
In contrast, open constructed-response items allow respondents to develop a response 
to a question and to demonstrate the depth of their thinking on mathematics knowledge 
and mathematics teaching knowledge. 

Examples of item types developed for the knowledge measurements are given in Section 
9 (Appendix B). These include samples of the actual items trialed but not selected for 
the main study. 

3.5 Beliefs 

Similar to the arguments given about the importance of content and general knowledge 
in teaching, there is wide agreement that beliefs are an important influence on teaching. 
Nevertheless, there is no conclusive evidence that beliefs can be effectively influenced 
by teacher preparation or that they are an intrinsic characteristic of those individuals 
who become teachers (Tatto & Coupland, 2003). In TEDS-M, this measurement area is 
informed by previous work done by the Teaching and Learning to Teach Study at MSU 
(Deng, 1995; Tatto, 1996, 1998, 1999b, 2003), and by the work of other international 
scholars (Grigutsch, Raatz, & Torner, 1998; Ingvarson, Beavis, Danielson, Ellis, & 
Elliott, 2005; Ingvarson, Beavis, & Kleinhenz, 2007). The TEDS-M beliefs scales include 
questions in five areas: beliefs about the nature of mathematics; beliefs about learning 
mathematics; beliefs about mathematics achievement; beliefs about preparedness for 
teaching mathematics; and beliefs about program effectiveness. 


12 The proportion of question formats varies by level of education (primary and secondary). Exact percentages are 
MC and CMC: 72.8% for primary and 73.5% for secondary. For CR, they are 27.1% for primary and 26.5% for 
secondary. 
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3.5.1 Beliefs about the Nature of Mathematics 

The items included in this area include questions that explore how future teachers 
perceive mathematics as a subject (e.g., mathematics as formal, structural, procedural, 
or applied). The items are based on work by Grigutsch et al. (1998) and by Ingvarson 
et al. (2005, 2007). 

3.5.2 Beliefs about Learning Mathematics 

This area includes questions about the appropriateness of particular instructional 
activities, questions about students’ cognition processes, and questions about the 
purposes of mathematics as a school subject. 

3.5.3 Beliefs about Mathematics Achievement 

This area taps into future teachers’ beliefs about various teaching strategies used 
to facilitate learning of mathematics. Other questions explore beliefs about how 
mathematics learning may take place, and yet others explore the application of 
attribution theory to teaching and learning interactions (e.g., innate ability for learning 
mathematics). 

The items used to measure the area described in Sections 3.5.1, 3.5.2, and 3.5.3 come 
from a number of studies, including those by Deng (1995), the feasibility study for 
TEDS-M (Schmidt et al., 2007), and several studies by Tatto (1996, 1998, 1999b, 2003). 

3.5.4 Beliefs about Preparedness for Teaching Mathematics 

The fourth area of belief relevant to TEDS-M concerns the extent to which future 
teachers perceive their teacher preparation has given them the capacity to carry out 
the central tasks of teaching and to meet the demands of their first year of practice. 
The items in these scales are therefore designed to explore different areas of teacher 
preparation impact. At the end of the questionnaire, a direct question is used to confirm 
these views. 

The preparedness scale used in the TEDS-M study is based on the ACER Preparedness 
to Teach inventory, a robust measure based on extensive research (Ingvarson et al., 2005, 
2007). Eor the TEDS-M study, the items included measure preparedness to teach in 
areas such as assessment, management of learning environments, and practices for 
engaging students in effective learning, and the extent to which teachers become active 
members of their professional community. 

3.5.5 Beliefs about Program Effectiveness 

In addition to asking a question about the overall effectiveness of teacher preparation 
to help future teachers learn to teach mathematics, six items probe future teachers’ 
beliefs about the degree to which their instructors modeled good teaching practices, 
used research, and used evaluation and reflection in their courses. The future teachers 
are also asked if their instructors valued their (the future teachers’) various experiences 
before and during their teacher preparation program. 

Section 9 (Appendix B) shows examples of the items included in the beliefs sub-scales. 
In all belief areas, many more items were trialed than used — a practice that brings 
efficiency and precision to the final TEDS-M data collection because the result is shorter 
instruments based on only the best-performing items. 
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3.6 Opportunities to Learn (OTL) 

TEDS-M uses the concept of OTL as central to explaining the impact of teacher 
preparation on teacher learning. Torsten Husen was the first person to define and 
use this term in order to explain student learning in lEA’s First International Study of 
Achievement in Mathematics (FIMS): 

... [w]hether or not . . . students have had the opportunity to study a particular topic or 
learn how to solve a particular type of problem presented by the test ... If they have not 
had such an opportunity, they might in some cases transfer learning from related topics to 
produce a solution but certainly their chance of responding correctly to the test item would 
be reduced. (Husfe, 1967, cited in Burstein, 1993) 

Others, prior to Husen and since, have simply defined this concept as “time allowed 
for learning” (Carroll, 1963). Scholars have also continued to argue that the concept 
of OTL “has changed how researchers, educators, and policymakers think about 
the determinants of student learning” (McDonnell, 1995, p. 317) and, in the case of 
TEDS-M, about the determinants of teacher learning. Moreover, lEA studies dating 
back to FIMS have empirically tested teachers’ perceptions of students’ OTL and found 
them to correlate highly with student achievement scores for mathematics test items. 

TEDS-M explores this concept in teacher education. Inclusion of OTL in the study 
serves a number of purposes: as an explanation of differences in levels of knowledge; 
as an indicator of curricular variation among countries; as an aspect of fairness (e.g., 
appropriateness of language of test items); and as a representation of the diversity of 
content, both overall and for distinct groups of teachers. (For a full treatment of OTL as 
applied to teaching and learning, see Floden, 2002.) 

The TEDS-M survey includes a number of items and scales to allow exploration of 
the OTL that future mathematics teachers have across countries. These include 
opportunities to learn the following: (i) university- or tertiary- level mathematics; (ii) 
school-level mathematics; (iii) mathematics education/pedagogy; (iv) and education/ 
pedagogy. They also include opportunities to learn (v) how to accommodate classroom 
diversity and to reflect on practice; (vi) how to learn from school experience and the 
practicum, and (vii) how to learn in a coherent teacher education program. The items 
and scales as a whole evaluate coherence of the teacher education program, given that 
TEDS-M hypothesizes that program coherence has an important impact on teacher 
learning. 

Section 9 (Appendix B) contains selected examples of the items included in the OTL 
scales, as described in the following sections (3.6.1 to 3.6.7). 

3.6.1 Opportunity to Learn University- or Tertiary-level Mathematics 

The items in this area explore if future teachers have studied key mathematics topics 
(e.g., geometry- related topics, algebra, number theory, calculus, functions, etc.) . Because 
opportunities to learn in this area often occur before future teachers enter teacher 
preparation, these questions ask future teachers whether or not they have studied such 
topics “ever.” 
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3.6.2 Opportunity to Learn School-level Mathematics 

This area includes items exploring the interaction between mathematics pedagogy 
and mathematics content as it concerns the school curriculum, learning techniques 
for teaching mathematics topics, and student learning. In addition, this area includes 
items relating to the emphasis given to learning mathematics (e.g., at the level of the 
school curriculum or at a deeper level or heyond and with no relation to the school 
curriculum). 

3.6.3 Opportunity to Learn Mathematics Education/Pedagogy 

This area includes items exploring the interaction between mathematics content and 
pedagogy. Additional scales include items concerning the use of learning strategies in 
mathematics. Future teachers are asked to indicate whether or not they have studied 
each topic as part of their teacher preparation program. Other questions ask the future 
teachers how often they engage in a number of activities and learning strategies in their 
teacher preparation program. 

3.6.4 Opportunity to Learn General Knowledge for Teaching 

This scale includes items about topics considered relevant for all teachers to know, 
such as educational theory, general principles of instruction, classroom management, 
curriculum theory, and so on. As with the items in the previous knowledge areas, 
these items ask future teachers if they have studied such topics as part of their teacher 
preparation program. 

3.6.5 Opportunity to Learn to Teach for Diversity in and Reflection on 
Practice 

This area includes items about development and use of materials for teaching as well as 
items about accommodation of diverse levels of student learning. Other items focus on 
learning how to assess and reflect on one’s own teaching, and on developing strategies 
to improve one’s own professional knowledge. 

3.6.6 Opportunity to Learn in Schools and through the Practicum 

A far more extensive section asks more in-depth questions regarding in-school 
experience. These questions ask future teachers whether they spent time in the 
classroom in a primary or secondary school and, if so, for how long. The questions also 
ask the future teachers if they had a school supervisor assigned to them, the particular 
activities in which they engaged and at what levels, and whether they found the in-school 
experience helpful. An additional set of questions asks about diverse characteristics of 
the practicum (e.g., the role of the mentor, feedback received, standards, methods used, 
and the level of mathematics knowledge and pedagogy of the classroom teacher or 
mentor). 

3.6.7 Opportunity to Learn in a Coherent Teacher Education Program 

The coherence area includes items exploring program consistency across courses and 
experiences offered to future teachers, and whether there are explicit standards with 
expectations for what future teachers should learn from their respective programs. 
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3.7 Background and Demographics 

As is the case with all questionnaires in TEDS-M, the future teacher questionnaire 
includes a number of indicators of future teachers’ backgrounds and demographics. 
These indicators are of intrinsic interest and were selected on the basis of what the 
literature tells us about the types of factors that are likely to help us understand differences 
between and within countries. The questionnaire includes such variables as age, gender, 
and parents’ education/socioeconomic status; language spoken at home; nature and 
level of secondary school mathematics knowledge; information on academic/general 
education; area of specialization; routes into teaching; degrees obtained; teaching/ 
work experience; motivation/plans/intention to become a mathematics teacher; special 
circumstances/personal costs of becoming a teacher; and how long the future teacher 
plans to stay in the profession. See Section 9 (Appendix B) for an example. 


4. DATA ANALYSIS 


As described in the introduction to this framework, an important goal for this study 
is to provide policy-relevant information regarding the mathematics preparation of 
future teachers. The data are therefore reported comparatively to show variation in 
the mathematics and other related knowledge of future teachers as it occurs across 
the different routes to teacher preparation evident among the participating countries. 
Specifically, the analysis endeavors to accomplish the following: 

• Show the level and depth of the mathematics and related teaching knowledge 
attained by prospective primary and lower secondary teachers across the different 
routes studied in the participating countries. These findings are examined vis-a-vis 
expectations apparent in the standards set in the K-12 mathematics curriculum and 
in the mathematics and related content teacher education curriculum. 

• Characterize the OTL provided in terms of the level and depth of knowledge and 
in terms of the internal and external coherence and other features related to the 
organization of instruction. 

• Characterize the policy environments that support future primary and lower 
secondary teachers at national and institutional levels attain high levels of mathematics 
preparation for teaching mathematics. 

4.1 Preliminary Analysis 

For initial reporting purposes, descriptive statistical analysis (e.g., means, standard 
deviations, and correlations) for selected individual items will be used to provide 
information about patterns of responses on questionnaire items by programs, across 
institutions, across routes within each country, and across countries. 

4.2 Item and Scale Analyses 

Within TEDS-M, several sets of questions were designed to create scales or broader 
measures of important constructs. Item analysis and scale development include three 
primary steps. First, mathematics and mathematics pedagogy knowledge and belief 
items are evaluated for functionality (few missing responses, variability in responses). 
Second, items are combined into sets based on the intended constructs as defined in 
Section 3 of this document. Third, based on this prior intent for the items, confirmatory 
factor analysis is used to assess the quality of each scale and, where appropriate, of 
second-order correlations among sub-scales. Fourth, based on the fit-indices and the 
item-loadings, decisions regarding selection of items for final assignment to scales are 
considered (DeVellis, 2003). Next, scaling methods based on item response theory 
(IRT) are used to establish measurement invariance as a function of item functioning 
across countries/languages (e.g., differential item functioning) and to establish secure 
meaningful scale scores measuring each construct. IRT analysis provides information 
about item fit, item contribution (information) to the scale, and other measurement 
properties of the scale, including reliability. This process is appropriate for both 
dichotomously and polytomously scored cognitive items and for the rating scale of 
attitudinal items. Additional validity-related evidence regarding expected relationships 
among scales are assessed with inter-scale correlations (Bond & Fox, 2001). 
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4.3 Analysis of Variability within and between Countries 

The analysis models multivariate relationships while taking into account the nested 
structure of the data. For example, via multilevel modeling, the analysis examines 
relationships between future teachers’ mathematical knowledge and contextual 
information regarding teacher education programs and national teacher education 
policies. Multilevel models allow for the assessment of relationships within each 
level of data (within [aggregated] programs, within institutions, and within routes) 
and of interactions among levels (e.g., where the effect of a particular institutional 
characteristic depends on the route or on the nature of a national policy). Alternatively, 
or in addition to, the described first approach to modeling, the analysis is expected to 
model all three levels (policy context, institutions, and outcomes), with non-significant 
variables removed one at a time until the model is left with only significant variables. 
Models using (aggregated) programs as the units of analysis are also explored. 

The plan for analysis includes the implementation of statistical tests appropriate for 
each research question. These analyses typically include descriptive analyses of the 
variables involved in the particular research question, followed by an evaluation of the 
distributional properties of variables for selection of appropriate statistical tests and the 
modeling of outcomes. 

Scale score difference is examined (using the general linear model) for background 
variables such as gender, degree level, etc. The general linear model (GLM) allows for 
weighted least- squares analyses and for multivariate analyses (simultaneous testing 
of multiple outcomes) with explanatory variables in multiple forms, including group 
membership (categorical variables) and covariates (continuous variables). 

In the case of categorical variables, non-parametric statistical procedures are proposed 
(e.g., Spearman’s rank correlations. Chi-square analyses, or Kruskal- Wallace tests). 
Finally, in order to understand the nature of the relationship among the major 
constructs proposed in the conceptual model, structural equation modeling may 
be employed to assess the interaction of major constructs and contextual variables. 
Additional procedures are used to accommodate the sampling design in the estimation 
of variances and standard errors. 

Each analysis involves estimation of a common effect size to facilitate comparisons of 
multiple effects. These analyses also explore the effects of item-by-country interaction 
and, as in other lEA studies, use national sub-samples for international calibration. 

4.4 Curriculum Analyses 

The TEDS-M curriculum analyses of syllabi, policy documents, and other curriculum 
data will permit comparison of curricular differences between programs, institutions, 
routes, and countries. Eor example, appropriate indices are used to estimate 
correspondence between K-12 curriculum standards and the teacher education 
curriculum at the primary and secondary levels. This correspondence is examined in 
relation to background variables and other institutional contextual variables. Curricular 
variables are also used in the multivariate modeling. Displays illustrate correspondences 
across curricular levels. 
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4.5 Cost Analyses 

Mathematics teacher preparation costs vary among institutions within countries and 
vary greatly across countries. The data on costs are limited to that obtained from 
questionnaires and are supplemented with data gathered from correspondents in 
the participating countries. These data compare the costs per program regarding the 
annual budget for the particular year of the study as well as those costs contributed 
by other programs and/or departments. The study also collects data on the budget for 
instruction (e.g., teaching staff salaries), and on whether or not future teachers are 
given subsidies for living expenses. Other questionnaire data such as the number of 
future teachers prepared yearly by level allow us to estimate the total cost of preparing 
primary, middle school, and high school teachers of mathematics in various institutions 
in each country. These costs per student are then compared with the results from the 
main part of the study, which show the opportunities that future teachers are given to 
learn mathematics. These comparisons bring insights into whether teachers are better 
prepared in mathematics teaching largely as a function of higher spending on their 
training, or whether other factors are at play. 



5. TIMELINES/PRODUCTS (Abridged) 


TEDS-M spans four years. The following is a summary of the main activities and 
products (P) for those years. 

October 2005 to September 2006 

• Revision and distribution of the first and second drafts of the conceptual 
framework document (P) 

• Initiation of national studies of policy and curriculum analysis 

• Initiation of literature reviews of mathematics teacher education research 

• Review, adaptation, and development of new items for future primary-level 
teachers 

• Review, adaptation of feasibility study (MT21) instruments, and additional item 
development for future lower secondary-level teachers 

• Item pilot, revision, and development of additional items 

• Development of instruments and procedures for field trial 

• Design of national TEDS-M probability samples of TP institutions, future teachers, 
and educators 

• 1st NRC meeting 13 to 16 Eebruary 2006, Hamburg 

2nd NRC meeting 3 to 8 September 2006, East Lansing, Michigan, USA 

October 2006 to September 2007 

• Conduct field trial of instruments and procedures (P) 

• 3rd NRC meeting 25 to 29 June 2007, Chinese Taipei 

• Einalization of instruments for the studies of institutions, educators, and future 
teachers based on the field trial of instruments and procedures 

• Execution of sample designs 

• Review of survey operation procedures manuals (P) 

• Revision and release of field trial edition of the conceptual framework document 

(P) 

• Continuation work on national reports on policy studies and curriculum analysis 

(P) 

• Quality control monitoring seminar, 27 to 28 August 2007, Amsterdam, the 
Netherlands 

• Data management seminar, 27 to 28 September 2007, Hamburg, Germany 

• Draft and review of final international report on cost study. Phase 1 (P) 

October 2007 to September 2008 

• Scoring training workshop for constructed response items, 29 November to 
1 December 2007, Miami, USA 

• Quality control monitoring seminar, 21 to 22 January 2008, Amsterdam, the 
Netherlands 

• Scoring training workshop for constructed response items, 7 to 9 April 2008, 
Eribourg, Switzerland 

• K-12 curriculum, national teacher education curriculum and institution syllabi 
coding workshop, 9 to 13 June 2008, Warsaw, Poland 

• 4th NRC meeting, 1 to 5 September 2008, Bergen, Norway 


13 Additional funding will be sought for a study of beginning teachers that will follow the TEDS-M survey, with the 
aim of extending the measures of the achieved curriculum of teacher education to the first years of teaching. 
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• Revision and publication of final version of conceptual framework document (P) 

• Publication of final international report on cost study (P) 

• Main data collection in Southern Hemisphere and Northern Hemisphere 

• Entering, scoring, cleaning, weighting, and scaling of data 

• Analysis of data 

• Draft and review of international reports Vols. 1 through V 

October 2008 to December 2009 

• 5th NRC meeting, March 2009, Chicago, Illinois, USA 

• 6th NRC meeting, June 2009, Santiago, Chile 

• Release of international report on national policy studies (P) 

• Final review of draff international report Vols. 1 through V 

• Final review of draft cost study 

January 2010 to September 2010 

January 2010 

• Press release January 2010, Washington DC 

• Release of international reports Vols. 1, 11, III (P) 

• Release of international report on cost study (P) 

June to September 2010 

• Release of international reports Vols. IV and V (P) 

• Release of the TEDS-M technical report (P) 

• Release of international database and user guide (P) 


6. DISSEMINATION 


6.1 Release of TEDS-M Study Materials to the Public 

TEDS-M is scheduled to end its first study cycle in 2009. In line with lEA policy, the 
study instruments (including items and other measurement strategies) and data are 
released into the public domain after publication of the international reports. Moreover, 
because this study may be extended to beginning teachers, a substantial number of 
items will not be released so that approximate trend data can be obtained in subsequent 
years. Experience from other lEA surveys indicates that the release of the database for 
TEDS-M will take place approximately nine months after the release of the international 
report. 

The international report will be published as a series with the title: Policy, Practice, and 
Readiness to Teach Primary and Secondary Mathematics: The Teacher Education and 
Development Study in Mathematics International Report. Volumes in the series are: 

• Volume 1: National Policies and Regulatory Arrangements for the Mathematics 
Preparation of Future Teachers; 

• Volume 2: Institutions, Programs, and Opportunities to Learn for the Mathematics 
Preparation of Future Teachers; 

• Volume 3: Mathematics and Related Outcomes Achieved among Prospective Primary 
and Lower Secondary Teachers; 

• Volume 4: Program Characteristics, Opportunities to Learn, and Outcomes in the 
Mathematics Preparation of Future Teachers; and 

• Volume 5: TEDS-M Encyclopedia. 

As in other lEA surveys, the national research centers will be given access to the 
international data in a pre-released and embargoed form before the release of the 
international report so that they can prepare their national reports. The international 
and national reports will probably be released simultaneously. 

6.2 Format 

Because most researchers use SPSS, fully documented and labeled SPSS files are included 
in the international database. Depending on the requests and needs of countries, SAS 
or raw data files may also be provided. Codebooks, exhaustively detailing all variables 
and their corresponding values and characteristics, and a comprehensive user guide are 
provided alongside the data. 



7. lEA TEDS-M MANAGEMENT AND 
ORGANIZATIONAL CHART 


International Association for the Evaluation of Educational Achievement (lEA) 

The Teacher Education Study in Mathematics (TEDS-M) is sponsored by the 
International Association for the Evaluation of Educational Achievement (lEA). lEA is 
incorporated under Belgian law as a consortium of research institutions in 60 countries. 
Since the 1960s, lEA has carried out many important and influential large-scale, cross- 
national studies in education, including the very well-known Third International 
Mathematics and Science Study (TIMSS). During TEDS-M, the lEA Secretariat has 
managed translation verification and international quality control of the data collection 
programs. 

TEDS-M Joint Management Committee 

lEA established the Joint Management Committee (JMC) to act as the decision- 
making body to oversee the whole TEDS-M study. Maria Teresa Tatto of Michigan State 
University (MSU) is the study director and chair of this committee. The JMC consists 
of the study director, the two co-directors from the international study center at MSU 
(Sharon Senk and John SchwiJle), and the three co-directors from ACER (Lawrence 
Ingvarson, Ray Peck, and Glenn Rowley). Ex officio, non-voting members include the 
lEA executive director (Hans Wagemaker), the TEDS-M sampling referee Jean Dumais 
from Statistics Canada, and other representatives of the lEA Secretariat and the lEA 
Data Processing and Research Center. 

The JMC is responsible for overall project planning and for ensuring sound financial, 
personnel, and logistical management, as well as for accountability to lEA and the 
funding agencies. Areas in which the committee acts as coordinator and broker for the 
study include facilitating relationships with participating lEA national centers as well 
as with funding agencies; procuring funds; and contracting and subcontracting for the 
study. It is also responsible for recruiting countries to join the study; for study design, 
timelines, reports, and archives; and for designating the work of outside experts on the 
study. 

The JMC reports and is accountable to the lEA General Assembly, Standing Committee, 
and the Technical Executive Group (TEG) on behalf of TEDS-M. The TEG comprises 
a group of methodologists internationally known for their expertise in the type of 
research conducted by lEA. Their task is to ensure that the design of each lEA study 
conforms to lEA technical standards (as outlined in Martin, Rust, & Adams, 1999). 

The International Study Center at Michigan State University 

MSU is the lead institution for TEDS-M. The major responsibilities of MSU are as 
follows: 

• To provide overall leadership and the administrative direction of the study; 

• To develop, incorporate, and oversee all plans for the design and execution of the 
study within a comprehensive conceptual framework document to be published by 
lEA; 

• To initiate proposals for and seek definition of JMC-assignments for instrument 
development; 
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• To coordinate the overall technical/scientific, operational, and analytic aspects for 
Components I, II, and III; and 

• To coordinate the publication of the international reports, technical report, and the 
study database in collaboration with lEA/DPC. 

MSU has primary responsibility for the development and authorship of the conceptual 
framework, the technical report, and the final international reports. In addition, it has 
primary authorship over the study concerning the mathematics preparation of secondary 
school teachers, including the development of relevant data-gathering instruments 
for the item pilot, field test, and main data collection, the conduct of relevant data 
analyses, and preparation of relevant sections of the final international reports. MSU is 
responsible for accomplishing other tasks as decided by the JMC and the annual work 
plan. The MSU international study center is accountable to the United States National 
Science Foundation (NSF) for its partial funding of TEDS-M, and to lEA. 

The Australian Council for Educational Research 

The Australian Council for Educational Research (ACER) team supports the TEDS-M 
international study center at MSU with technical and research management expertise. 
ACER has primary responsibility over the study concerning the mathematics preparation 
of primary school teachers, including the development of relevant data-gathering 
instruments for the item pilot, field test, and main data collection, the conduct of 
relevant data analyses, and the preparation of relevant sections of the final international 
reports. In addition, ACER is responsible for preparing and participating in meetings 
of the JMC; preparing budgets for ACER’s work in the project; accomplishing follow- 
up actions arising out of national research center meetings as required by the JMC or 
annual work plan; and accomplishing other such work as decided by the JMC and the 
annual work plan. The ACER team is accountable to the lEA and to the international 
study center at MSU. 

lEA Data Processing and Research Center (DPC) 

The DPC in Hamburg has been the data-processing department of TEA since 1995. 
The increasing number of international studies and the increasing number of countries 
participating in them, along with the ever more complex research designs, have placed 
higher demands on data processing, analysis, dissemination, and training. The lEA 
DPC has developed the capability to respond to all such demands. lEA executive 
director Hans Wagemaker assumes overall responsibility for the lEA DPC, while 
operative management responsibilities within the DPC rest with Heiko Sibberns and 
Dirk Hastedt. 

lEA DPC responsibilities for TEDS-M include, among others, sampling in close 
consultation with the TEDS-M sampling referee; support relevant to instrument 
development, codebooks, operational manuals, within-institution sampling and 
tracking using the lEA WinW3S software; data entry using the lEA WinDEM software; 
scoring procedures, documentation, verification and approval of national and cultural 
adaptations; data cleaning and processing; item almanacs; reliability statistics; creation 
of an international database to be used with statistical packages; organization of training 
seminars on the use of these data; and preparation of applicable parts of the TEDS-M 
technical report. 


lEATEDS-M MANAGEMENT AND ORGANIZATIONAL CHART 
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TEDS-M International Sampling Referee 

The sampling referee, in consultation with the other partners, is responsible for 
developing an international master sampling plan for the study. This plan provides 
guidelines for the national centers to develop national plans that translate the international 
plan into the specifics of their own contexts and systems. The international sampling 
referee is then responsible for judging whether each national plan is adequately based 
on the international plan. This person also negotiates and adjudicates any deviations 
from the master plan. The referee is also responsible for overseeing the drawing and 
execution of the sample in collaboration with the DPC. The international sampling 
referee for TEDS-M is Jean Dumais of Statistics Canada. 

National Research Coordinators (NRCs) 

According to TEA policy and practice, each participating country must have a national 
center capable of carrying out the study and raising aU the necessary funds for the 
within-country work. Each country designates a national research center and a 
coordinator (NRC) to direct its part of the study. NRCs play a key role internationally in 
guaranteeing that their country is adequately and accurately taken into account within 
the overall study design, analysis, and reporting. NRCs provide input to the project via 
continuous communication with the project director, the staff in the international study 
center at MSU, the DPC, other designated TEDS-M staff, and at the NRC meetings. 

Under TEDS-M, each NRC is responsible for collecting relevant policy documentation 
on mathematics teacher recruitment, selection, and certification policies, and teacher 
policies on mathematics preparation. The NRC also collects information about the 
mathematics teacher education curricula and primary and secondary school curricula, 
and the national-level data required for the cost study. The NRC is responsible for 
filling out protocols and for bringing together focus groups to answer questions left 
unanswered by the document analysis. In addition, the NRC is responsible for gaining 
entrance to the teacher education institutions and finding the most appropriate 
person(s) to answer the institutional questionnaire. NRCs need to have a dedicated 
investigator per institution to administer surveys to the educators, and to help gain 
access to the implemented curriculum (e.g., syllabi, texts, and examinations used in the 
program by the selected educators). 

NRCs conduct the teacher education curriculum analysis according to agreed guidelines. 
They are also responsible for implementing the sample design and for appointing a 
researcher to institutions to organize the application of the survey of future teachers in 
their last year in teacher education. Each NRC is encouraged to analyze the TEDS-M 
national data in the context of data from other countries in order to produce a national 
report tailored to the issues of teacher education policy and practice most important to 
the country in question. The NRC should also prepare and execute a dissemination plan 
to ensure that the findings of the study are brought to the attention of and discussed 
with target audiences. 

The national research centers for TEDS-M represent the following countries: Botswana, 
Canada (Manitoba, Newfoundland and Labrador, Nova Scotia, Ontario, Quebec), Chile, 
Chinese Taipei, Georgia, Germany, Malaysia, Norway, Oman, Philippines, Poland, 
Russian Federation, Singapore, Spain, Switzerland (German-speaking cantons), Thai- 
land, and the United States. 
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TEDS-M Project Advisors 

TEDS-M also has a number of project advisors who meet occasionally to provide 
advice to the JMC. This group of advisors includes experts in the fields relevant 
to TEDS-M and is chaired by Maria Teresa Tatto of MSU, chair of the JMC for 
TEDS-M. 

Funding 

In addition to receiving funds from TEA, TEDS-M receives international costs from 
the United States National Science Foundation (NSF) (REC 0514431 9/15/2005 to 
9/15/2009). Maria Teresa Tatto is the principal investigator and project director, and 
John Schwille and Sharon Senk are co-principal investigators. Each participating 
country is responsible for funding national project costs and implementing TEDS-M in 
accordance with international procedures established by the International Study Center 
at MSU and by lEA. 

TEDS-M Organizational Chart 
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9. APPENDICES 


APPENDIX A: STUDY DESIGN AND DATA SOURCES 

Primary Future Teachers Mathematics Instrument Design 

The design for the primary study has the following characteristics: 

• A rotated 5-hlock design (Table 9.1) that permits estimation and analysis of the full 
covariance matrix, and that includes enough items and score points to generate IRT 
(item response theory) scales and reports hy sub-domain. 

Table 9.1 Design for Primary Booklets 


Main Primary Booklets: Rotated Blocks for Knowledge Items 



Mathematics Knowledge for Teaching 

Booklet 1 

B1PM, B2PM 

Booklet 2 

B2PM, B3PM 

Booklet 3 

B3PM, B4PM 

Booklet 4 

B4PM, B5PM 

Booklet 5 

B5PM, B1PM 


Key: B1PM to B5PM = mathematics blocks primary (1 -5). 


• Three mathematics content knowledge (MCK) sub-domains (algebra, geometry, 
and number and data), proportionally represented to reflect the international 
curricula (as per the TEDS-M analysis of the K-12 mathematics curriculum in the 
participating countries). Each sub-domain has a minimum of 12 items. The number 
of score points per MCK sub-domain is at least 17, and likely ranges are shown in 
the last column of Table 9.2. The two mathematics pedagogy content knowledge 
(MPCK) sub-domains (curriculum and planning, and enacting) also have at least 12 
items each and at least 20 score points. The domains and sub-domains are shown in 
Table 9.2. 


Table 9.2 Primary Items by Sub-domains, Blocks, and Score Points 



Number of Items in Assessment Blocks 

Items 

Estimated Range of 
Score Points 

Sub-domain 

B1 

B2 

B3 

B4 

B5 

Total 


Algebra 

2 

3 

4 

4 

2 

15 

21-27 

Geometry 

2 

2 

3 

3 

2 

12 

17-22 

Number and data 

5 

4 

3 

2 

4 

18 

26-39 

MathPedI (curriculum 
and planning) 

2 

2 

3 

2 

4 

13 

22-24 

MathPed2 (enacting) 

2 

3 

1 

4 

2 

12 

20-24 

TOTAL 

13 

14 

14 

15 

14 

70 

106-136 
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• Item assignment to the blocks to ensure sufficient variation of items in terms of 
cognitive domains, number of score points, and mathematics and/or mathematics 
pedagogy level (novice, intermediate, and advanced). These distributions are shown 
in Tables 9.3 and 9.4. 


9.3 Primary Mathematics Items by Cognitive Domain and Sub-domain 



Knowing 

Applying 

Reasoning 

Total No. of Items 

Algebra 

10 

5 

0 

15 

Geometry 

4 

5 

3 

12 

Number and data 

11 

4 

3 

18 


9.4 Primary Items by Level of Difficulty and Sub-domain 



Novice 

Intermediate 

Advanced 

Total No. of Items 

Algebra 

6 

5 

4 

15 

Geometry 

4 

6 

2 

12 

Number and data 

8 

6 

4 

18 

MathPedI (curriculum 
and planning) 

1 

8 

4 

13 

MathPed2 (enacting) 

0 



9 

3 

12 


In regard to the levels of difficulty by sub-domain, note that because of the many criteria 
that had to be met (expert opinions, psychometric data, item types, etc.) and because 
of the item categorization judgments made about each item, it was not possible to find 
an “enacting” item in the pool at the novice level. These “levels” are estimates only. It 
is therefore possible, and even likely, that there will be a need to re-categorize after the 
initial analysis. This is an empirical aspect of this research study. 

Lower Secondary Future Teachers Mathematics Instrument Design 

The design for the secondary booklets has the following characteristics: 

• As with the primary booklets, the rotated 3-Block design (Table 9.5) for the secondary 
booklets allows analysis of the full covariance matrix and provides enough items and 
score points to generate IRT scales. 

Table 9.5 Design for Lower Secondary Blocks 


Main Lower Secondary Booklets: Rotated Blocks 



Mathematics Knowledge for Teaching 

Booklet 1 

BISM, B2SM 

Booklet 2 

B2SM, B3SM 

Booklet 3 

B3SM, B4SM 


Key: B1 SM to B3SM = mathematics blocks secondary (1-3). 
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• Three reporting sub-domains for MCK: algebra, geometry, and number. Data is not 
a reporting sub-domain. Data is proportionally less represented in the international 
curricula. This is why the number of the items is not sufficient to build a sub-scale. 
Data items are included for the completeness of the domains. The MPCK domain 
will be reported as an intact domain (i.e., it does not include sub-domains). Each 
of the reporting (sub-) domains has at least 17 score points. The domains and sub- 
domains are shown in Table 9.6. 


Table 9.6 Lower Secondary Items by Sub-domains, Blocks, and Score Points 



Number of Items in Assessment Blocks 

Items 

Score Points 


Block 1 

Block 2 

Block 3 

Total 


Algebra 

6 

3 

3 

12 

20-25 

Geometry 

4 

5 

3 

12 

21-28 

Number 

2 

2 

5 

9 

17-34 

Data* 

1 

1 

2 

4 

6 

MathPed 

3 

5 

4 

12 

18-29 

TOTAL 

16 

16 

17 

49 

82-122 


Note: Although we have included items on data, "data" in itself is not a reporting sub-domain. 


• Item assignment to the blocks ensures sufficiently balanced coverage in terms 
of cognitive domains, number of score points, and mathematics level (novice, 
intermediate, and advanced). These distributions are shown in Tables 9.7 and 9.8. 


9.7 Secondary Mathematics Items by Cognitive Domain and Sub-domain 



Knowing 

Applying 

Reasoning 

Total No. of Items 

Algebra 

2 

7 

3 

12 

Geometry 

2 

5 

5 

12 

Number 

4 

3 

2 

9 

Data* 

1 

2 

1 

4 


Note: Although we have included items on data, "data" in itself is not a reporting sub-domain. 


9.8 Secondary Items by Level of Difficulty and Sub-domain 



Novice 

Intermediate 

Advanced 

Total No. of Questions 

Algebra 

3 

5 

4 

12 

Geometry 

3 

7 

2 

12 

Number 

1 

6 

2 

9 

Data* 

2 

1 

1 

4 

Mathematics Pedagogy 

7 

1 

5 

1 

0 

1 

12 


Note: Although we have included items on data, "data" in itself is not a reporting sub-domain. 
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Overall Design for the Main Study Booklets 

The overall structure of the TEDS-M field trial booklets for primary and secondary 
future teachers is presented in Table 9.9. 

To enable coverage of a wide range of content areas and to prevent over-burdening each 
participant, test items are typically arranged in a number of blocks. These blocks are 
assigned to booklets so that each participant takes only one form, that is, a subset of the 
items only.'^ 

Table 9.9 Overall Design for Main Study Booklets 


Primary Booklet Design 


PM1 

PM2 

PM3 

PM4 

PM5 


BACK 

BACK 

BACK 

BACK 

BACK 

Background 

OTL 

OTL 

OTL 

OTL 

OTL 

Opportunity to Learn 

B1PM 

B2PM 

B3PM 

B4PM 

B5PM 


B2PM 

B3PM 

B4PM 

B5PM 

B1PM 

Mathematics Knowledge for Teaching 

BEL 

BEL 

BEL 

BEL 

BEL 

Beliefs about Mathematics and 
Teaching 


Secondary Booklet Design 


SMI 

SM2 

SM3 


BACK 

BACK 

BACK 

Background 

OTL 

OTL 

OTL 

Opportunity to Learn 

B1PM 

B2PM 

B3PM 


B2PM 

B3PM 

B1PM 

Mathematics Knowledge for Teaching 

BEL 

BEL 

BEL 

Beliefs about Mathematics and 
Teaching 


14 The optimal test design is the balanced incomplete (7) blocks (BIB) test design. The lEA-TEG October 2006 and 
the MSU international study center considered this design classic but too cumbersome. 
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9.10 Summary of Domains and Sources of Data for TEDS-M National Studies 

Future Teachers 


Route Study 















X 















X 

Educators 

Field-based 

experience 
















X 

X 

X 


X 

X 

X 

X 






General 

pedagogy 















X 

X 

X 


X 

X 

X 

X 







Maths and maths 
pedagogy 















X 

X 

X 


X 

X 

X 

X 




Cost Studies 




Institution 












X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 


X 

X 

Country 


X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

Curriculum Studies 

X 

X 

X 



Dimension/ Constructs 

Sub-domains 

Route to full qualification as primary (mathematics) teacher 

Structure 

Curriculum 

Capabilities and background of future teachers 

Types of schools and grade levels graduates are prepared for 

Route to full qualification as secondary (mathematics) teacher 

Structure 

Curriculum 

Capabilities and background of future teachers 

Types of schools and grade levels for which graduates are prepared 

Policy Studies 

Policies on primary mathematics teaching 

Policies on secondary mathematics teaching 

Characteristics of teacher education 

Characteristics of future teachers 

Characteristics of educators/staff 

Requirements 

Goals (intended and realized) 

Selectivity 

Assessment 

Standards 

Program accountability 

Quality assurance 

Characteristics of teacher education mathematics curriculum 

Characteristics of K-12 mathematics curriculum 

Salary 

Institution 

Private 
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9.11 Summary of Domains and Sources of Data for the Study of TP Institutions, Programs, and their Outcomes (contd.) 
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Future Teachers 



X 

X 

X 

Beliefs/Attitudes/Perspectives 

X 

X 

X 

X 

Mathematics Knowledge 

X 

X 

Mathematics Pedagogy Knowledge 

X 

X 

X 


X 

X 

X 

X 

Educators 

Field-based 

experience 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

General Knowledge for Teaching 





General 

pedagogy 

X 

X 

X 

X 

X 

X 

X 






X 

X 

X 

X 

Maths and maths 
pedagogy 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 





Institution 


X 

X 

X 














Country 


















Dimension/Constructs 

Sub-domains 

Teaching Methods Used in Program 

Quality 

Nature 

Methods 

Nature of teacher education 

Nature of mathematics and mathematics knowledge 

Nature of teaching and learning mathematics 

Nature of schools/schooling/general pedagogy 

Subject-matter domain: number, data, and probability, geometry 
and measurement, algebra 

Cognitive domain: knowing, applying, reasoning. 

Mathematical curricular knowledge 

Knowledge of planning for mathematics teaching and learning 

Knowledge of enacting mathematics for teaching and learning 

Knowledge of students 

Knowledge to manage the classroom environment 

Assessment 

Professional responsibilities 
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APPENDIX B: ITEM SAMPLES 

Sample Items for Mathematics Pedagogy Content Knowledge 
1. Primary 


Categorization 


Domain: 

Mathematics Pedagogy Content Knowledge (MPCK) 

Sub-domain: 

Enacting— analyzing or evaluating student's mathematical solutions or 
arguments; providing appropriate feedback. 

Level: 

Intermediate 

Response type: 

Multiple-choice 


Mr. Lewis was surprised when one of his students came up with a new procedure for subtraction 
(pictured below), and he wondered whether it would always work. He showed it to Ms. Braun, next 
door, and asked her what she thought. 

37 

-19 


-2 

20 

18 


How do you think Ms. Braun should respond? 

A. She should tell Mr. Lewis the procedure works for this problem but would not 
work for all numbers. 

B. She should tell him this does not make sense mathematically. 

C. She should let Mr. Lewis know that this would work for all numbers. 

D. She should say that this procedure only works in special cases. 


Check one box. 

□ 

□ 

□ 

□ 


Source: Ball and Hill (2002). 

Note: Modification Part E, “I’m not sure,” was deleted. 
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2. Primary 

Categorization 


Domain: 

Mathematics Content Knowledge (MCK) 

Sub-domain: 

Data 

Performance: 

Reasoning 

Level: 

Novice 

Response type: 

Constructed (short) 


A teacher gave the following problem to her class. 

The numbers in the sequence 7, 11, 15, 19, 23, increase by 4. The numbers in the sequence 1, 10, 

19, 28, 37, ... increase by nine. 

The number 19 is in both sequences. 

If the two sequences are continued, what is the next number that is in BOTH the first and the second 
sequence? 

(a) What is the correct answer to this problem? 


Source: TIMSS 2003 released item. 

Scoring Guide 


Code 

Response 

Item: TD1P060A 


Correct response 

10 

55 


Incorrect response 

70 

Either of the responses "27 and 46" or 

"19" indicating a misreading of the question. 

71 

Any other incorrect value, probably indicating a calculation error. 

79 

Other incorrect (including crossed out, erased, stray marks, illegible, or off-task). 


Non-response 

99 

Blank 
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2. Primary (contd) 


Categorization 


Domain: 

Mathematics Pedagogy Content Knowledge (MPCK) 

Sub-domain: 

Enacting— analyzing or evaluating students' mathematical solutions or arguments 

Level: 

Intermediate 

Response type: 

Constructed 


(b) A student gives the response 27 and 46 to the question above. What is the most likely reason for 
this response? 


Source: ACER, Melbourne, Australia, 2006. 


Scoring Guide 


Code 

Response Item; TD1P060B 


Correct response 

20 

A response that recognizes thatthe student has misread, misinterpreted, or misunderstood 
the question and explains the likely misinterpretation. 

Examples: The student misinterpreted the question to mean, "What is the next number 
in each sequence/both sequences?" 

The student interpreted "BOTH" as meaning give "two" answers. 


Partially correct response 

10 

A limited response that recognizes that the student has misread, misinterpreted, or 
misunderstood the question but does not explain the likely misinterpretation. 

Example: The student misread/misunderstood the question. 

11 

A response that simply explains that 27 and 46 are the next numbers in each sequence 
(but does not give a reason why the student has answered this way). 

Examples: They are the next numbers in each sequence. 

The student gave the next numbers in each sequence rather than the "same" number 
in each. 


Incorrect response 

79 

Other incorrect (including crossed out, erased, stray marks, illegible, or off-task) 


Non-response 

99 

Blank 


Non-response 



APPENDICES 


75 


3. Primary/Secondary 


Categorization 


Domain: 

Mathematics Content Knowledge (MCK) 

Sub-domain: 

Data (chance) 

Level: 

Primary— advanced; Secondary— intermediate/novice 

Response type: 

Complex multiple-choice 


Your students are examining the three spinners shown below. 

They are discussing the probability that the spinner stops over a shaded region. 



Spinner 1 



Spinner 2 



Please indicate whether the following statements of four students are Completely True, Partly True or 
Completely False. If one sentence is true, but the other is false, check Partly True. 




Check one box in each 

row. 



Completely 

True 

Partly 

True 

Completely 

False 

A. 

Sherry says, "The probability is twice as large for 
Spinners 2 and 3 compared to Spinner 1 because they 
have two regions to stop on and Spinner 1 has only 
one region." 

□ 

□ 

□ 

B. 

George says, "Spinners 1 and 2 have the same 
probability since the shaded regions have the same area. 
Spinner 3, however, has a higher probability than 
Spinner 2 because the shaded region is a larger area." 

□ 

□ 

□ 

C. 

Paul says, "Spinners 1, 2 and 3 have the same probability 
because the angles of the shaded regions are the same 
size." 

U 

U 

U 

D. 

Rainey says, "The probabilities for Spinners 1 and 2 are 
the same because those areas are the same proportion 
of the whole circle. For Spinners 2 and 3, however, the 
probabilities are different because the shaded areas for 
Spinner 3 are a bigger proportion of the whole square 
than they are of the circle." 

□ 

□ 

□ 


Source: Prof. W. Whitely, York University, Toronto, Ontario, Canada. 

Modification: Degrees added to diagrams. Dotted circle added to third diagram. Some modifications 
made to wording and also to the rating of the extent to which each statement is correct. 
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3. Primary/Secondary (contd.) 

Key: 

A Completely false 

B Partly true 

C Completely true 

D Partly true 

Notes: It is unlikely that each part can be considered as dependent. Therefore, this is not suggested as 
four separate items. However, for measurement purposes, it could be possible to develop a reasonable 
scoring rule, such as: 

• Score 2 — all four parts rated correctly. 

• Score 1 — any three parts rated correctly. 
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4. Secondary 


Categorization 


Domain: 

Mathematics Content Knowledge (MCK) 

Sub-domain: 

Algebra 

Performance: 

Applying 

Level: 

Advanced 

Response type: 

Constructed 


The graph of the function y=x-sin x is given below. 



Determine at which of point A or point B the slope of the graph is greater. Show your work in the box 
below. 


Source: Kiril Bankov. 
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Scoring Guide 


Code 

Response Item; TD1S120 


Correct response 

20 

The response indicates that the slope of the graph at point A and point B is the same, 
and correct work is shown. 

Example: 

lfy = x-sinx,y'= 1- cos x. At x = k/ 2, y'= 1 and at x = 3n/2, y'= 1, so the slopes at points 
A and B are equal. 


Partially correct response 

10 

The response correctly shows the derivative of the given function, but contains error in 
the value of the derivative at point A (or point B), and therefore concludes that the slopes 
of the tangents to the given function at point A and point B are not the same. 

11 

Response that indicates that the slopes of the graph at points A and B are equal-based 
on a chain of reasoning that is partly correct and partly incorrect. 


Incorrect response 

70 

Responses that indicate an attempt to take the derivative of the given function, 
but there is no correct work. 

79 

Other incorrect (including crossed out, erased, stray marks, illegible, or off-task). 


Non-response 

99 

Blank 
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Sample Items for Beliefs about Mathematics and Mathematics Teaching 


1. Beliefs about the nature of mathematics 

To what extent do you agree or disagree with the following beliefs about the nature of 
mathematics? 


A. Mathematics is a collection of rules and procedures that 
prescribe how to solve a problem. 

B. Mathematics involves the remembering and application 

of definitions, formulas, mathematical facts and procedures. 

C. Mathematics involves creativity and new ideas. 

D. In mathematics many things can be discovered and 
tried out by oneself. 

E. When solving mathematical tasks you need to know the 
correct procedure or else you would be lost. 

F. If you engage in mathematical tasks, you can discover 
new things (e.g., connections, rules, concepts). 

G. Fundamental to mathematics is its logical rigor and 
preciseness. 

H. Mathematical problems can be solved correctly in many 
ways. 

I. Many aspects of mathematics have practical relevance. 

J. Mathematics helps solve everyday problems and tasks. 

K. To do mathematics requires much practice, correct 
application of routines, and problem-solving strategies. 

L. Mathematics means learning, remembering and applying. 


Check one box in each row. 


01 

01 

0 ) 

0 ) 

0 » 

D> 

S 

01 

01 

W 

<0 

>, 


at 

D> 

_>s 

O) 

c 

o 

O) 

a 

_D> 

O) 

0 ) 

0 ) 

w 

< 

D> 

C 

0 

Cfi 

□i 

□2 

□3 

□4 

□5 

a 

Q 

□2 

□3 

Q 

□5 

Be 

Q 

□2 

□3 

□4 

□5 

Be 

Q 

□2 

□3 

Q 

□5 

Be 

Q 

□2 

□3 

□4 

□5 

□6 

□t 

□2 

□3 

Q 

□5 

Q 

Q 

□2 

□3 

□4 

□5 

□a 


□2 

□3 

Q 

□5 

□6 


□2 

□3 

□4 

□5 

□6 

Q 

□2 

□3 

□4 

□5 

□e 

Q 

□2 

□3 

□4 

□5 

□e 

Q 

□2 

□3 

□4 

□5 

□6 
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2. Beliefs about learning mathematics 

From your perspective, to what extent would you agree or disagree with each of the 
following statements about learning mathematics? 

Check one box in each row. 


A. 

B. 

C. 

D. 

E. 

F. 

G. 

H. 

I. 

J. 

K. 

L. 

M. 


N. 


D> 01 


The best way to do well in mathematics is to memorize all 
the formulas. 

□t 

b 

□2 

□3 

1/1 

Q 

< 

□5 

Q 

Pupils need to be taught exact procedures for solving 
mathematical problems. 

Q 

□2 

□3 

□4 

□5 


It doesn’t really matter if you understand a mathematical 
problem, if you can get the right answer. 

Q 

□2 

□3 

Q 

□5 


To be good in mathematics you must be able to solve 
problems quickly. 

□i 

□2 

□3 

Q 

□5 

□5 

Pupils learn mathematics best by attending to the teacher’s 
explanations. 

Q 

□2 

□3 

Q 

□5 

□e 

When pupils are working on mathematical problems, 
more emphasis should be put on getting the correct 
answer than on the process followed. 

Q 

□2 

□3 

□4 

□5 

□e 

In addition to getting a right answer in mathematics, it is 
important to understand why the answer is correct. 

Q 

□2 

□3 

Q 

□5 

□6 

Teachers should allow pupils to figure out their own ways 
to solve mathematical problems. 

□t 

□2 

□3 

Q 

□5 

Q 

Non-standard procedures should be discouraged because 
they can interfere with learning the correct procedure. 

Q 

□2 

□3 

□4 

□5 

□e 

Hands-on mathematics experiences aren’t worth the time 
and expense. 

Q 

□2 

□3 

Q 

□5 


Time used to investigate why a solution to a mathematical 
problem works is time well spent. 

Q 

□2 

□3 

□4 

□5 

□6 

Pupils can figure out a way to solve mathematical problems 
without a teacher’s help. 

Q 

(N 

□ 

□3 

Q 

□5 

Q 

Teachers should encourage pupils to find their own 
solutions to mathematical problems even if they are 
inefficient. 

Q 

□2 

□3 

□4 

□5 

□e 

It is helpful for pupils to discuss different ways to solve 
particular problems. 


□2 

□3 

□4 

□5 

□6 
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3. Beliefs about mathematics achievement 

To what extent do you agree or disagree with each of the following statements about 
pupil achievement in <primary/lower secondary> mathematics? 


Check one box in each row. 


A. Since older pupils can reason abstractly, the use of 
hands-on models and other visual aids becomes less 
necessary. 

B. To be good at mathematics you need to have a kind 
of “mathematical mind”. 

C. Mathematics is a subject in which natural ability matters 
a lot more than effort. 

D. Only the more able pupils can participate in multi-step 
problem-solving activities. 

E. In general, boys tend to be naturally better at mathematics 
than girls. 

F. Mathematical ability is something that remains relatively 
fixed throughout a person’s life. 

G. Some people are good at mathematics and some aren’t. 

H. Some ethnic groups are better at mathematics than others. 


□l 

□2 

□3 

Q 

□5 

□6 

a 

□2 

□3 

Q 

□5 

□6 

Q 

□2 

□3 

Q 

□5 


Q 

□2 

□3 

Q 

□5 


Q 

□2 

□3 

□4 

□5 

□6 

Q 

□2 

□3 

Q 

□5 

Q 

Q 

□2 

□3 

□4 

□5 

□a 

Q 

□2 

□3 

Q 

□5 



82 


TEDS-M CONCEPTUAL FRAMEWORK 


4. Beliefs about preparedness for teaching mathematics 

Please indicate the extent to which you think your teacher education program has 
prepared you to do the following when you start your teaching career. 

Check one box in each row. 


A. Communicate ideas and information about mathematics 
clearly to pupils 

B. Establish appropriate learning goals in mathematics for pupils 

C. Set up mathematics learning activities to help pupils achieve 
learning goals 

D. Use questions to promote higher order thinking in mathematics 

E. Use computers and ICT to aid in teaching mathematics 

F. Challenge pupils to engage in critical thinking about mathematics 

G. Establish a supportive environment for learning mathematics 

H. Use assessment to give effective feedback to pupils about their 
mathematics learning 

I. Provide parents with useful information about your pupils’ 
progress in mathematics 

J. Develop assessment tasks that promote learning in mathematics 

K. Incorporate effective classroom management strategies into your 
teaching of mathematics 

L. Have a positive influence on difficult or unmotivated pupils 

M. Work collaboratively with other teachers 


z 

□t 

< 

□2 

< 

□3 

< 

□4 

□l 

□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 

□l 

□2 

□3 

□4 
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5. Beliefs about program effectiveness 

To what extent do you agree or disagree with the following statements? 

The instructors who teach mathematics-related <courses> in your current teacher 
preparation program: 

Check one box in each row. 


A. Model good teaching practices in their teaching 

B. Draw on and use research relevant to the content of 
their <courses> 

C. Model evaluation and reflection on their own teaching 

D. Value the learning and experiences you had prior to 
starting the program 

E. Value the learning and experiences you had in your field 
experience and or practicum 

F. Value the learning and experiences you had in your teacher 
preparation program 



Q 

b 

□2 

in 

□3 

□4 

< 

□5 

5 ^ 

Q 

Q 

□2 

□3 

□4 

□5 

□e 

Q 

□2 

□3 

Q 

□5 


□i 

□2 

□3 

□4 

□5 

□6 

Q 

□2 

□3 

Q 

□5 

Q 

Q 

□2 

□3 

□4 

□5 

□e 
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Sample Items for Opportunities to Learn 
1. University- or tertiary-level mathematics 

Consider the following topics in university-level mathematics. Please indicate whether 
you have ever studied each topic. 


A. Foundations of Geometry or Axiomatic Geometry 
(e.g., Euclidean axioms) 

B. Analytic/Coordinate Geometry (e.g., equations of lines, curves, 
conic sections, rigid transformations or isometrics) 

C. Non-Euclidean Geometry (e.g., geometry on a sphere) 

D. Differential Geometry (e.g., sets that are manifolds, curvature of 
curves, and surfaces) 

E. Topology 

F. Linear Algebra (e.g., vector spaces, matrices, dimensions, eigenvalues, 
eigenvectors) 

G. Set Theory 

H. Abstract Algebra (e.g., group theory, field theory, ring theory, ideals) 

I. Number Theory (e.g., divisibility, prime numbers, structuring integers) 

J. Beginning Calculus Topics (e.g., limits, series, sequences) 

K. Calculus (e.g., derivatives and integrals) 

L. Multivariate Calculus (e.g., partial derivatives, multiple integrals) 

M. Advanced Calculus or Real Analysis or Measure Theory 

N. Differential Equations (e.g., ordinary differential equations and partial 
differential equations) 

O. Theory of Real Functions, Theory of Complex Functions or Functional 
Analysis 

R Discrete Mathematics, Graph theory. Game theory. Combinatorics or 
Boolean Algebra 

Q. Probability 

R. Theoretical or Applied Statistics 

S. Mathematical Logic (e.g., truth tables, symbolic logic, propositional 
logic, set theory, binary operations) 


Check one box in each row. 
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2. School-level mathematics 

Consider the following list of mathematics topics that are often taught at the <primary> 
or <secondary> school level. Please indicate whether you have studied each topic as 
part of your current teacher preparation program. 

Check one box in each row. 


A. Numbers (e.g., whole numbers, fractions, decimals, integer, rational, 
and real numbers; number concepts; number theory; estimation; ratio 
and proportionality) 

B. Measurement (e.g., measurement units; computations and properties 
of length, perimeter, area, and volume; estimation and error) 

C. Geometry (e.g., 1-D and 2-D coordinate geometry. Euclidean 
geometry, transformational geometry, congruence and similarity, 
constructions with straightedge and compass, 3-D geometry, vector 
geometry) 

D. Functions, Relations, and Equations (e.g., algebra, trigonometry, 
analytic geometry) 

E. Data Representation, Probability, and Statistics 

F. Calculus (e.g., infinite processes, change, differentiation, integration) 

G. Validation, Structuring, and Abstracting (e.g.. Boolean algebra, 
mathematical induction, logical connectives, sets, groups, fields, 
linear space, isomorphism, homomorphism) 


T3 4 _, 

3 o 

□i Q 
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3. Mathematics education/pedagogy 


Consider the following list of mathematics education/<pedagogy> topics. Please indicate 
whether you have studied each topic as part of your current teacher preparation 
program. 

Check one box in each row. 


A. Foundations of Mathematics (e.g., mathematics and philosophy, 
mathematics epistemology, history of mathematics) 

B. Context of Mathematics Education (e.g., role of mathematics in 
society, gender/ethnic aspects of mathematics achievement) 

C. Development of Mathematics Ability and Thinking (e.g., theories of 
mathematics ability and thinking; developing mathematical concepts; 
reasoning, argumentation, and proving; abstracting and generalizing; 
carrying out procedures and algorithms; application; modeling) 

D. Mathematics Instruction (e.g., representation of mathematics content 
and concepts, teaching methods, analysis of mathematical problems and 
solutions, problem-posing strategies, teacher-pupil interaction) 

E. Developing Teaching Plans (e.g., selection and sequencing the 
mathematics content, studying and selecting textbooks and instructional 
materials) 

F. Mathematics Teaching: Observation, Analysis and Reflection 

G. Mathematics Standards and Curriculum 

H. Affective Issues in Mathematics (e.g., beliefs, attitudes, mathematics 
anxiety) 


~ -M 

E o 
K z 

□i Q 

Q Q 
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4. Education and pedagogy 

Consider the following topics in education and <pedagogy>. Please indicate whether 
you have studied each topic as part of your current teacher preparation program. 

Check one box in each row. 


A. 


B. 

C. 

D. 

E. 


F. 

G. 

H. 


■O ... 

E ° 


History of Education and Educational Systems (e.g., historical 
development of the national system, development of international 
systems) 

□t 

□2 

Philosophy of Education (e.g., ethics, values, theory of knowledge, 
legal issues) 

Q 

□2 

Sociology of Education (e.g., purpose and function of education in 
society, organization of current educational systems, education and 
social conditions, diversity, educational reform) 

Q 

□2 

Educational Psychology (e.g., motivational theory, child development, 
learning theory) 

□i 

□2 

Theories of Schooling (e.g., goals of schooling, teacher’s role, 
curriculum theory and development, didactic/teaching models, 
teacher-pupil relations, school administration and leadership) 

Q 

□2 

Methods of Educational Research (e.g., read, interpret and use 
education research; theory and practice of action research) 

Q 

□2 

Assessment and Measurement: Theory and Practice 

□t 

□2 

Knowledge of Teaching (e.g., knowing how to teach pupils of different 
backgrounds, use resources to support instruction, manage classrooms, 
communicate with parents) 

□t 

□2 
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5. Teaching for diversity and reflection on practice 

In your teacher preparation program, how often did you have the opportunity to learn 
to do the following? 

Check one box in each row. 


A. Develop specific strategies for teaching students with 
behavioral and emotional problems 

B. Develop specific strategies and curriculum for teaching pupils 
with learning disabilities 

C. Develop specific strategies and curriculum for teaching 
gifted pupils 

D. Develop specific strategies and curriculum for teaching pupils 
from diverse cultural backgrounds 

E. Accommodate the needs of pupils with physical disabilities in 
your classroom 

F. Work with children from poor or disadvantaged backgrounds 

G. Use teaching standards and codes of conduct to reflect on your 
teaching 

H. Develop strategies to reflect upon the effectiveness of your 
teaching 

I. Develop strategies to reflect upon your professional knowledge 

J. Develop strategies to identify your learning needs 


O 


0 ) 

Z 

□t 

cc 

□2 

0 

□3 

0 

□4 

□t 

□2 

□3 

□4 


□2 

□3 

□4 


□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 


□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 


□2 

□3 

□4 
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6. School experience and the practicum 

During the school experience part of your program, how often were you required to do 
each of the following? 

Check one box in each row. 


A. Observe models of the teaching strategies you were learning in 
your <courses> 

B. Practice theories for teaching mathematics that you were 
learning in your <courses> 

C. Complete assessment tasks that asked you to show how you 
were applying ideas you were learning in your <courses> 

D. Receive feedback about how well you had implemented teaching 
strategies you were learning in your <courses> 

E. Collect and analyze evidence about pupil learning as a result of 
your teaching methods 

F. Test out findings from educational research about difficulties 
pupils have in learning in your <courses> 

G. Develop strategies to reflect upon your professional knowledge 

H. Demonstrate that you could apply the teaching methods you 
were learning in your <courses> 


<0 

c 

o 

TO S 


0 ) 

Z 

□t 

cc 

□2 

0 

□3 

0 

□4 


□2 

□3 

□4 


□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 


□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 
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7. Coherence of the teacher education program 


Consider all of the <courses> in the program including subject matter <courses> 
(e.g., mathematics), mathematics <pedagogy> <courses>, and general education 
<pedagogy> <courses>. Please indicate the extent to which you agree or disagree with 
the following statements. 


A. Each stage of the program seemed to be planned to meet the 
main needs I had at that stage of my preparation. 

B. Later <courses> in the program built on what was taught in 
earlier <courses> in the program. 

C. The program was organized in a way that covered what I needed 
to learn to become an effective teacher. 

D. The <courses> seemed to follow a logical sequence of 
development in terms of content and topics. 

E. Each of my <courses> was clearly designed to prepare me to 
meet a common set of explicit standard expectations for 
beginning teachers. 

F. There were clear links between most of the <courses> in my 
teacher education program. 


Check one box in each row. 


0) 

1) 


b 


at 

at 

o> 


_o> 


at 

01 

to 




at 

at 

< 


□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 

□t 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□l 

□2 

□3 

□4 

□t 

□2 

□3 

□4 
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Sample Items for Background and Demographics 

Motivation/plans/intention to become a mathematics teacher 

To what extent does each of the following identify your reasons for becoming a 
teacher? 


Check one box in each row. 


A. 

I was always a good student in school. 

□l 

< 

□2 

< 

□3 

< 

□4 

B. 

I am attracted by the availability of teaching positions. 

□l 

□2 

□3 

□4 

C. 

I love mathematics. 

□l 

□2 

□3 

□4 

D. 

I believe that I have a talent for teaching. 

□l 

□2 

□3 

□4 

E. 

I like working with young people. 

□l 

□2 

□3 

□4 

F. 

I am attracted by teacher salaries. 

□t 

□2 

□3 

□4 

G. 

I want to have an influence on the next generation. 

□t 

□2 

□3 

□4 

H. 

I see teaching as a challenging job. 

□t 

□2 

□3 

□4 

I. 

I seek the long-term security associated with being a teacher. 

□l 

□2 

□3 

□4 
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APPENDIX C: EXPERT PANEL MEETINGS 

Table 9.12 Specialized Advisory/Expert Panel Meetings for TEDS-M, November 2002 


Meeting 

Participants 

Country/ Affiliation 

Special lEA advisory meeting on 

Fernand Rochette 

Belgium (FI) 

approval of TEDS-M 

Liselotte Van De Perre 

Belgium (FI) 

Brussels, Belgium 

Ann Van Driessche 

Belgium (FI) 

November 4-5, 2002 

Marcel Crahay 

Belgium (Fr) 


Julien Nicaise 

Belgium (Fr) 


Per Fibaek 

Denmark 


Bjarne Wahlgren 

Denmark 


Gerard Bonnet 

France 


Catharine Regneir 

France 


Ranier Lehmann 

Germany 


Georgia K. Polydores 

Greece 


Bruno Losito 

Italy 


Ryo Watanabe 

Japan 


Andris Kangro 

Latvia 


Jean-Claude Fandel 

Luxembourg 


Jean-Paul Reeff 

Luxembourg 


Seamus Hegarty 

UK 


Arlette Delhaxe 

Eurydice 


Barbara Malak-Minkiewicz 

lEA Secretariat 


Maria Teresa Tatto 

TEDS-M-MSU 


Table 9.13 Specialized Advisory/Expert Panel Meetings for TEDS-M, June 2003 


Meeting 

Participants 

Country/ Affiliation 

lEA TEDS expert panel meeting 

Peter Fensham 

Australia 

Amsterdam, Netherlands 

Kiril Bankov 

Bulgaria 

June 16-21, 2003 

Martial Dembele 

Burkina Paso and Quebec 


Beatrice Avalos 

Chile 


Per Fibaek 

Denmark 


Sigrid Blomeke 

Germany 


Frederick Leung 

Hong Kong SAR 


Losito Bruno 

Italy 


Ciaran Sugrue 

Ireland 


Lee Chong-Jae 

Korea 


Loyiso Jita 

South Africa 


Marilyn Leask 

UK 


Christopher Day 

UK 


Michael Eraut 

UK 


Drew Gitomer 

USA 


Susanna Loeb 

USA 


Lynn Paine 

USA 


David Plank 

USA 


Paul Sally 

USA 


William Schmidt 

Pre-TEDS-MSU 


Adrian Beavis 

lEA-TEDS-M ACER 


Lawrence Ingvarson 

lEA-TEDS-M ACER 


Jack Schwille 

IEA-TEDS-M MSU 


Maria Teresa Tatto 

Pre-TEDS and lEA-TEDS-M MSU 


APPENDICES 


93 


Table 9.14 Specialized Advisory/Expert Panel Meeting for TEDS-M, December 2003 


Meeting 

Participants 

Country/ Affiliation 

lEA TEDS expert panel meeting 

Peter Fensham 

Australia 

Hamburg, Germany 

Kiril Bankov 

Bulgaria 

December 1-5, 2003 

Beatrice Avalos 

Chile 


Per Fibaek Laursent 

Denmark 


Sigrid Blomeke 

Germany 


Frederick Leung 

Hong Kong SAR 


Ciaran Sugrue 

Ireland 


Bruno Losito 

Italy 


Tenoch Cedillo Avalos 

Mexico 


Marcela Santillan-Nieto 

Mexico 


Loyiso C. Jita 

South Africa 


Marilyn Leask 

UK 


Angelo Collins 

USA 


Lynn Paine 

USA 


Hans Wagemaker 

lEA 


Pierre Foy 

Boston College, 



previously at lEA DPC 


Dirk Hastedt 

lEA DPC 


Lawrence Ingvarson 

lEA-TEDS-M ACER 


Jack Schwille 

lEA-TEDS-M MSU 


Maria Teresa Tatto 

IEA-TEDS-M MSU 


Table 9.15 Specialized Advisory/Expert Panel Meetings for TEDS-M, 18 September 2006 


Meeting 

Participants 

Country/ Affiliation 

Expert panel for review of primary TEDS-M 

Prof Doug Clarke 

Australian Catholic University 

items (Mathematics Content Knowledge and 

Prof Peter Sullivan 

Monash University 

Mathematics Pedagogy Content Knowledge) 

Prof Kaye Stacey 

Melbourne University 

Melbourne, Australia 

Dr Gaye Williams 

Deakin University 

September 18, 2006 

Prof Barb Clarke 

Monash University 


Ann Roche 

Australian Catholic University 


Ray Peck 

ACER 


Lawrence Ingvarson 

ACER 


Table 9.16 Specialized Advisory/Expert Panel Meetings for TEDS-M, 
29-30 September 2006 


Meeting 

Participants 

Country/ Affiliation 

Expert panel for review of TEDS-M Items 

Kiril Bankov 

Bulgaria 

Grand Rapids, Michigan, USA 

Jarmila Novotna 

Czech Republic 

September 29-30, 2006 

Paul Conway 

Ireland 


Ruhama Even 

Israel 


Kyungmee Park 

Korea 


Maarten Dolk 

Netherlands 


Ingrid Munck 

Sweden 


Hyacinth Evans 

West Indies 


Lynn Paine 

lEA-TEDS-M MSU 


Sharon Senk 

lEA-TEDS-M MSU 


Jack Schwille 

lEA-TEDS-M MSU 


Maria Teresa Tatto 

lEA-TEDS-M MSU 
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Table 9.17 Specialized Advisory/Expert Panel Meetings for TEDS-M, June 2006 


Meeting 

Participants 

University 

Expert panel for review of TEDS-M items 

Edward Aboufadel 

Grand Valley State University 

and data from field trial 

Sandra Crespo 

Michigan State University 

East Lansing, Michigan, USA 

Glenda Lappan 

Michigan State University 

June, 2006 

Vince Melfi 

Michigan State University 


Jeanne Wald 

Michigan State University 


Rebecca Walker 

Grand Valley State University 
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APPENDIX D: LIST OF NATIONAL RESEARCH CENTERS PARTICIPATING IN TEDS-M 


Country 

Name 

Affiliation 

Botswana 

Thabo Jeff Mzwinila 

TIokweng College of Education 

Canada 

Pierre Brochu 

Pan-Canadian Assessment Program, Council of Ministers of 
Education, Canada 

Chile 

Beatrice Avalos 

Ministry of Education, Chile, Unidad de Curriculum y Evaluacion 

Chinese Taipei 

Feng-Jui Hsieh 
Pi-Jen Lin 

National Taiwan Normal University, Department of Mathematics; 
National Hsinchu University of Education, Department of 
Applied Mathematics 

Georgia 

Maia Miminoshvili 
Tamar Bokuchava 

NAEC— National Assesment and Examination Center 

Germany 

Sigrid Blomeke 

Humboldt University of Berlin, Eaculty of Arts IV 

Malaysia 

Mohd Mustamam Abd. Karim 
Rajendran Nagappan 

Universiti Pendidikan Sultan Idris 

Norway 

Liv Granmo 

ILS, University of Oslo 

Oman 

Zuwaina Al-maskari 

Math Curriculum Department, Ministry of Education 

Philippines 

Ester Ogena 
Evangeline Golla 

Science Education Institute, Department of Science and 
Technology 

Poland 

Michal Eederowicz 

Institute of Philosophy and Sociology, Polish Academy of Sciences 

Russian Federation 

Galina Kovaleva 

Center for Evaluating the Quality of Education, Institute for 
Content of Methods of Learning, Russian Academy of Education 

Singapore 

Khoon Yoong Wong 

National Institute of Education, Nanyang Technological University 

Spain 

Luis Rico 

University of Granada 

Switzerland 

Eritz Oser 
Horst Biedermann 

University of Fribourg 

Thailand 

Precharn Dechsri 
Supatra Pativisan 

The Institute for the Promotion of Teaching Science and 
Technology 

United States 

William Schmidt 

Michigan State University 






This document outlines the framework and a comprehensive plan for a cross- 
national study of primary and secondary mathematics teacher education (TEDS-M) 
sponsored by the International Association for the Evaluation of Educational 
Achievement (lEA). 

TEDS-M 2008, which builds on the results of lEA student achievement studies, 
focuses on how teachers are prepared to teach mathematics in primary and lower 
secondary schools. 

TEDS-M is a study of the variation in the nature and impact of teacher education 
programs within and across countries. The study collects and analyzes nationally 
representative data from participating countries to address contested issues and 
improve policy and practice in teacher education. This document lays out the goals 
and justification for this study as well as its design and methodology. 

The overall study has three overlapping components: 

• COMPONENT I: Studies of teacher education policy, schooling, and social contexts 
at the national level. 

• COMPONENT II: Studies of primary and lower secondary mathematics teacher 
education routes, institutions, programs, standards, and expectations for teacher 
learning. 

• COMPONENT III: Studies of the mathematics and related teaching knowledge of 
future primary and lower secondary school mathematics teachers. 

The key research questions for the study focus on the relationships between these 
components, such as relationships between teacher education policies, institutional 
practices, and future teacher outcomes. 




Errata 


Page 73, Appendix B 

The following Primary item has been incorrectly categorized as Data. It should be Algebra. 

2. Primary 


Categorization 


Domain: 

Mathematics Content Knowledge (MCK) 

Sub-domain: 

Data 

Performance: 

Reasoning 

Eevel: 

Novice 

Response type: 

Constructed (short) 


A teacher gave the following problem to her class. 

The numbers in the sequence 7, 11, 15, 1 9, 23, increase by 4. The 

numbers in the sequence 1, 10, 19, 28, 37, ... increase by nine. 

The number 19 is in both sequences. 

If the two sequences are continued, what is the next number that is in 
BOTH the first and the second sequence? 

(a) What is the correct answer to this problem? 


Page 95, Appendix D 

Correction: Poland’s NRC is Michal Sitek. 

Correction: Spain’s NRC is Ministerio de Educacidn: Instituto de Evaluacion, Instituto 
Superior de Eormacidn y Recursos en Red para el Profesorado, y Secretaria del Consejo de 
Coordinacidn Universitaria and Universidad de Granada 



